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We follow the development of probability theory from the beginning of the 
' last century, emphasising that quantum theory is really a generalisation of this 

f*^S , theory. The great achievements of probability theory, such as the theory of pro- 

s ! ' cesses, generalised random fields, estimation theory and information geometry, 

are reviewed. Their quantum versions are then described. 
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The are few mathematical topics that are as badly taught to physicists as probability 
theory. Maxwell, Boltzmann and Gibbs were using probabilistic methods long before 
. ^ the subject was properly established as mathematics. Their language, of ensembles, 

^ ■ complexions, fluctuations and most probable state, are still used. When quantum the- 

ory came along, the same notions were fitted into the new theory, sometimes leading 
to confusion. We review the mathematical development of probability, emphasising 
that quantum theory is a generalisation. The approach to history is in the same spirit 
as used by Milligan in 

There are three 'philosophies' concerning probability. In the easy case, when there 
are finitely many possible outcomes to the experiment being considered, Laplace's 
principle of equal ignorance tells us that the probability of each of the outcomes is 
the same. In the case of a die with six sides, experiments suggest that the probabilities 
are not all exactly equal. Nevertheless, there is not much error if we assume that the 
probability of each number is 1/6. An objection to Laplace's principle in general is 
that it is not always clear that the outcome of a particular experiment is a matter of 
chance, even when we do not know which outcome will turn up; it could even be that 
a particular outcome is inevitable. Thus a more robust version of Laplace's principle 
might be that in events governed by chance, the probability of each possible outcome 
is the same. This still leaves open the meaning of the phrase, 'governed by chance'. 
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The difficulty of defining the 'uniform' distribution when variates take continuous 
values is illustrated by Bertrand's paradox (Q, p. 246). This demolished Laplace's 
principle for continuous variables. 

The philosophy of Laplace applied to probability theory might be described as 
Platonic. A real die is the shadow of the ideal die, which has perfect sides and exact 
probabilities of 1/6 for each outcome. This has a modern form of expression: we 
model the real die by the sample space Q = {1,2,... ,6} whose elements u are called 
outcomes, and assign the probability 1/6 to each. The value of a random variable f 
is known if we know the outcome u; f is therefore a real- valued function on 0. More 
generally, if the sample space is a finite set 0, an event E is a subset of Q; we say 
that the event has occurred if the oj that occurs lies in E. The probability that E 
occurs is the sum of the probabilities of the points in E: 

p(E) = PH- (1) 

We say that two events, E, F, are independent if p(E f] F) = p(E)p(F). In this 
way the binomial distribution can be derived for the total shown by n dice thrown 
independently, and all of Laplace's probability theory can be derived. It can tell us 
what bets to lay on an event E, even when only one trial is going to occur. 

Laplace's method has been successfully applied to statistical mechanics; the space 
of states is discretised, thus avoiding Bertrand's paradox (the choice of bins being 
suggested by quantum mechanics). Each bin is said to be equally probable, and some 
hypotheses about independence is postulated. Then it is shown that the complexion 
(macroscopic state) given by the Gibbs distribution is not just the most probable, 
but is overwhelmingly the most probable. The chance of any complexion minutely 
different is put at 10~ 170 . The Gibbs distribution is, of course, the equilibrium state; 
if it is so probable, how come systems manage to be out of equilibrium, and remain 
so for years at a time? This remark is not aimed at Tolman Q, who made it clear 
that the assumption of equal probabilities applies only to equilibrium, and is to be 
tested against experiment; it passes the test well, but he then spoils it by adding as 
a further justification, 'without this postulate there would be nothing to correspond 
to the circumstance that nature does not have any tendency to present us with sys- 
tems in conditions which we regard as mechanically entirely possible but statistically 
improbable'. The word 'improbable' is itself based on Laplace's assumption! 

The second 'philosophy' of probability can be described as Aristotelian; it had 
taken hold by 1920, and is known as the 'frequentist' approach. It is essential that 
we can reproduce a long run of independent trials each conducted under exactly the 
same experimental conditions. In this respect, the theory makes sense only within a 
scientific culture. Suppose that we have one 'variate', which may take continuous or 
discrete values. The result of a measurement of the variate is assigned to one of a 
preassigned set of 'bins', which are intervals on the real axis. We repeat a number 
of times, to find the histogram, that is, the number n, of events (out of N trials) in 
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the i bin. If the histogram settles down to a stable shape as we increase N, we 
declare that the value of the variate is random (or, random enough). We then define 
the probability of the event i to be 



This approach avoids the above problems that beset the Laplace philosophy. How- 
ever, it is completely useless as mathematics; a 'definition' should not depend on an 
infinite number of future experimental results. There is not one theorem that can be 
proved from this definition. Feller points out that we must avoid confusion between 
a definition, and a method of measurement. There is great heuristic value to the 
frequentist approach. It is easy to teach ||; we do not prejudge the possible values 
that the variate can have, or the probability of a given value; we can introduce an- 
other variate Y, and observe its distribution, and its joint probability distribution 
with X; we can by extending this idea get access to the joint probability distribution 
of any finite number of variates; we can get some idea as to whether the variates are 
random by examining a sequence of independent trials. We can even cover situations 
in which two variates are not simultaneously observable, as in quantum mechanics, 
by listing only the joint distributions of compatible observables, and omitting those 
we cannot measure. If we measure a variate X with n different values Xi with relative 
frequency pi, we can construct a sample space x±, . . . ,x n , and assign the probability 
Pi to the occurrence of the outcome Xj. Similarly, we can construct a sample space 
and probability for any finite set of compatible variates if each measurement records 
their values. The observed probabilities are more reliable than assuming all points 
are equally probable. 

However, there is one grave disadvantage of the approach, apart from not being 
mathematics: it is simply a description of data, and has much less predictive power 
than Laplace's method. In particular, the method takes no position on the question as 
to what are the possible variates. If f2 has |f2| = n points, then the random variables 
form a vector space, denoted A{£1), of dimension n, so that at most n random variables 
can be linearly independent. No similar constraint holds in the frequentist point of 
view. Thus a variate is not the same as a random variable. In fact, it has no definition, 
other than the statement that its values are random. 

The frequentist approach is the safest one to use in studies involving humans; 
social or financial matters are so complicated that it is not likely that a sample 
space, f2i say, chosen to accommodate the data observed so far, can describe all the 
possible new variates and the values available to them. In the frequentist approach, 
faced with a new variate, Y, one simply takes the set of possible values of Y, say 
^2 = {yi, ■ ■ ■ j Um}, and uses Ui x Sl 2 as the sample space of the enhanced problem. 

In a classical system in physics or chemistry, treated by classical statistical me- 
chanics, we want to follow the scientific method: we model the system, do exper- 
iments, and reject the model if forced to. In that case, we make another model, 
estimate its parameters, and suggest more testing experiments. We want and expect 



Pi = lim — . 
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to be able to make predictions about variates not measured yet. So we must reject 
the frequentist approach. 

The third philosophy of probability Qwas made clear by Kolmogorov, and com- 
bines something of the first two; it is to regard a probability theory as a model, to be 
tested against experiment. It is like Plato's ideal, in that it is based on a specified 
sample space f2; but now the probability p is not determined by pure thought; any p 
satisfying the axioms below provides us with a model. 

Definition 1.1 Let Q be a countable space. A map p : O — ► [0, 1] is a probability if 
p(u)) > and = 1- 

The probability of an event BCS1, and the concept of independence of two events, 
are then as in Laplace's theory and clearly depend on the choice of p. 

A random variable / : Q — > R is chosen to represent the variate being observed, 
the particular choice being part of the interpretation of the model. A theoretical idea, 
or else the first few experiments on the variate /, allow us to get some guide-lines for f2 
and the values of p. This is the subject of estimation theory. We can judge the validity 
of the model (the choices we have made for (0,p, /)) by comparing the predictions of 
the model with the observed frequencies n.j using the theory of significance tests. Both 
estimation theory and significance were developed before Kolmogorov's book. The 
founders of these techniques were often frequentists; they realised that one could not 
use an extreme frequentist point of view: in estimation, they often postulated that 
the data had Gaussian distributions, but with unknown parameters. In significance 
testing, to make a start, they assumed a probability distribution for the variate being 
measured; this is called the 'hypothesis H', which is part of the model; it can be 
rejected if the data are significantly unlikely. This has a version within Kolmogorov's 
formulation, in which we are given a probability space, the pair (p, Q), and model the 
variate with a random variable, /. To make contact with the well-established theory 
of estimation and significance, we must relate the probability distribution of / to the 
probability p. We now remind the reader how this is done. 

Given a finite probability space (p, O) and a random variable / : O — ► R, the 
probability distribution of / is denoted Pf(i), and is determined as follows: let Xi,i = 
1, 2, . . . , n be the values that / takes, and let Pf(i) be the probability that the event 
{lo : f(uj) = Xi}. That is 

p/(») := p^- ( 3 ) 

This is what is accessible to experiments when we measure /. The mean of / is 
determined by Xi and pf. 

E pif] '■= ^P^fiu) = ^2xip f (i), also written p.f. (4) 

UJ i 

Given two random variables on (Q,p), f,g we define the joint distribution, denoted 
Vf,g{i,j) to be 

Pf,g(hj) ■= PW : /M = x i and #M = Vj}- ( 5 ) 
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We say two r. v. are independent if the events {/(cj) = Xi} and {g{ui) = Dj} are 
independent for all This is equivalent to the frequentists' version: Pf t g(i,j) = 
Pf(i)p g (j). The joint distribution determines pj and p g as its marginals, and also all 
moments, e. g. the cross-moment E p [fg] can be shown to be J2ij x iVjPf,g{h j)- 

A probability p defines a linear functional on the set A(£l) by the expectation, 
(@) : / l— ¥ Ep[f]. We shall call any such functional a state: it is linear and positive, 
taking the value 1 on the sure function /. The dual space A d is the set of all linear 
functionals, so the states form a subset of A d ; it is denoted S(O). Given two states p\ 
and P2 and < A < 1, their mixture with probabilities A and 1— A, p = Api + (1 — X)P2, 
is again a state. So the states form a convex set. 

Whether 0, is countable or not, for a random variable / on (f2,f?) the probability 
of the occurrence of a single value /o might be zero, even when there is an luq £ Q with 
f(u>o) = /o; for, p(u>o) might be zero. This often happens when Q is not countable, and 
/ takes continuous values. Then, more information about the probability measure is 
provided by the 'cumulative' distribution function 

P f (x)=p{u:f{u)<x}. (6) 

This is an increasing function of x, going from at x = - ootolatx = oo. We say 
that / possesses a density pf if Pf(x) is differentiable, and we write 

. , dPf(x) ._. 
Pf( X ) = -JU (7) 

It is clear that we cannot cope with this subject without a certain amount of real 
analysis. 

A cumulative probability distribution Pf(x) is determined by its characteristic 
function 

C f (X) := J e iXx dP f (x) (8) 
Here we use the Stieltjes integral. Any characteristic function satisfies 

1. C(A) is continuous; 

2. C(0) = 1; 

3. C is of positive type: 

ij 

Conversely, any function C obeying 1,2 and 3 is the characteristic function of a 
probability distribution; this is Bochner's theorem. In terms of the original (Q,p) 
and random variable /, the characteristic function is 

C f (X) := E p [e iX f]. (9) 
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If Cf is analytic in A around A = 0, we can easily justify the expansion 



C f (X) = J2(^TE p [f n ]/n\ = Y,{i>) n M n /n\. 

n n 

here, M n are the n th moments of /; for this reason, Cf acts as a moment generating 
function for the r. v. /. An important variant of this is the cumulant generating 
function 

logC>(A) = X;(«'A) n «nM 

n 

We prefer to keep the imaginary unit in these formulas, since if we drop it the mean 
Cf(X) might not be finite. The cumulants n n are determined by induction from the 
system 

M n = ^^« ni ...v (10) 

k X k 

Here, = X\ U X2 U . . . U is an arbitrary partition of {1, 2, . . . , re} into k parts, 
including the identity partition, and rij = = 1, . . . ,k. The condition for inde- 

pendence, Pf, g (i,j) = Pf(i)p g (j) for all i,j is equivalent to Cf +g = CfC g ; it follows 
that then the cumulants of / + g are the sums of those of / and g. 

For a Gaussian distribution, all the cumulants beyond the second are zero. There 
are results of the following kind: if all the cumulants K n of a distribution are zero for 
re > N, then they are zero beyond n = 2, and so the distribution is Gaussian. These 
results use the positivity of the mean of a positive polynomial in /: 

£ z iZj M i+j = E[J^ z lZj f i+ i] = E{\ J2 Zif j \ 2 } > 0. (11) 

ij ij j 



Given a set of real numbers {M n } satisfying the positivity condition in (11), it is not 
obvious that M n is the n th moment of a random variable /, or that if so, / is unique. 
This has led to a body of work called the moment problem. 

The distribution of a random variable / determines that of any differentiable 
function g(f) of /; this is also a random variable; the density of the distribution of 
g is determined by the usual rule: if g is bijective, so that / is a function of g, the 
probability that g lies between y and y + dy is p g (y)dy, and this occurs if and only 
if / lies between x and x + dx, where y = g{x). Therefore p g dy = pfdx, giving the 
relation 

Pg = \(df/dg)\p f . (12) 

If g is not bijective, but has a local inverse with various branches, fi, then we have 
to sum over the contribution \(dfi/dg)\pf. of each branch. 

The remarkable thing is that the methods of probability theory give good results 
in many cases that are not governed by chance, such as the distribution of digits in 
7T. Another example is the configuration of a chaotic system at the time t, where 
t is large, given the initial configuration at time zero. If the initial state is not 
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specified sufficiently accurately, then the configuration at time t seems to be governed 
by chance, although it is not. It was suggested by Krylov || that statistical physics 
is a successful method exactly in the cases when the underlying dynamics is chaotic. 
This will occur when nearby initial points become exponentially far apart as time 
progresses, and this is signalled by a positive real part to the dominant eigenvalue of 
the linearised dynamics. This largest real part is called the Lyapunov index. We are 
talking here about a chaotic theory; actual experimental measurements will always 
have further uncertainty, influenced by small effects omitted from the theory. In a non- 
chaotic system small forces can be omitted in the first few approximations. However, 
in a chaotic system, the inclusion of one such small force can change the outcome of the 
calculation at the large time t, making it appear to be random. This is well modelled 
by omitting any attempt to include all the actual forces, replacing those omitted by 
a 'noise', that is, a random term. Thus, we expect chaos to be well-modelled by a 
system with increasing uncertainty, as measured by entropy. Kolmogorov, and then 
Sinai took up Krylov's cause, and were able to relate the rate of 'entropy' production 
to the Lyapunov exponent of the dynamics. However, Ruelle interprets this || as an 
increase in information, available as time goes by. 

Laplace's problem, of whether to assign equal probabilities to each energy-level of 
a system, arises in quantum theory. Krylov takes von Neumann to task for assuming 
that the density matrix for the state of a particle with spin produced by a quantum 
process should, in the absence of any theory or experiment, be taken to be totally 
unpolarised. Krylov says that this is not true for most known processes, as the 
polarisation is found to be nonzero, small for some and large for others. Krylov's 
view is that it should be assigned a general density matrix; we can then estimate this 
matrix in the light of experiments. This leads to the subject of quantum estimation, for 
which there is a body of theory. Krylov believed that physics is not in the gambling 
business; we do not second guess the state of the system and follow a strategy of 
hedging against wrong guesses; rather, in physics we predict what will happen (with 
various probabilities) at a later time, when the initial state is known. 

Estimation theory has received an impetus from a modern development, informa- 
tion theory. Shannon introduced the entropy of the random variable / taking values 

S f := - p f (xi) log pf(xi). (13) 

i 

Note that Sf does not depend on the actual values that / takes. The distribution with 
the maximum possible entropy is easily proved to be the uniform distribution. The 
school of probability known as Bayesian therefore argues that if we know nothing 
whatever about / it must be assigned the uniform distribution, called the prior. 
Thus, Laplace's intuition gets very respectable support. There is one big problem 
with this: the uniform distribution for / is not in general consistent with the uniform 
distribution for say g = / 3 , as we see from eq. (12); so the prior depends on the 
random variable we choose to name as the one we know nothing about. This echoes 



7 



Bertrand's paradox. 

A quantum version of entropy was earlier given by von Neumann. For the classical 
case (p,,p) with Q countable it reduces to 

s(p) : = -I>Miogj?M- ( 14 ) 

It does not make any reference to a random variable. We may obtain Shannon's 
entropy of a random variable / as the von Neumann entropy of pf regarded as a 
probability on the space of values that / takes. Note that Sf = S(p) if / takes 
different values at different points of f2, that is, if / separates the points of 0. We 
then say that / is a sufficient statistic. Sf is in general less than S(p), and it reduces 
to zero when / takes only one value. The entropies of Shannon and von Neumann 
are not the same concepts, and this difference reflects their different interpretations; 
the point to is the message, and Sf is the information about the message that is on 
average conveyed by measuring /; it cannot exceed S(p), which is the entropy (missing 
information) in the original probability space. Naturally, if / is sure it conveys no info 
at all. Since Sf depends on the random variable / only through its distribution, it 
has a meaning in the frequentist approach. To compute S(p), the model (£l,p) must 
be given, and it does not depend on /. More generally, we can define the Shannon 
entropy of a set (/i, . . . , f n ) as the von Neumann entropy of their joint distribution 
on the sample space of their values. Some authors regard the Shannon entropy as the 
physical entropy of a reduced description of a physical model. The trouble with this 
idea is that the introduction of noise in the measurement of / causes the Shannon 
entropy to decrease, instead of to increase as we would want. 

A simple example of noise is that caused by a mapping T : 0, — > Q. This defines 
a co-action on the set of random variables: / i— > T*f := / o T, which in fact in 
an endomorphism of A. If T is not bijective, there might be points that can be 
distinguished by measuring /, but not by measuring T*f; thus St*/ < Sf. This 
also holds more generally, when T* is a convex linear sum of such maps, thus: T* = 
J^AjTj*. It can be shown that this is the most general stochastic map on A, that 
is, linear map, taking I to I and non-negative functions to non-negative functions. 
The reduction in the information carried by / in the presence of noise is natural 
in telephony. The von Neumann entropy, on the other hand, increases if we add 
noise. This is achieved by a bistochastic map T, (a stochastic map whose adjoint 
is also stochastic). We write it as a right action, thus: p i— ► pT. By the deep 
theorem of Birkhoff 0, [|], a bistochastic matrix is a mixture of permutations. Since a 
permutation f2 does not alter S(p), and — plogp is concave, we see that S(pT) > S(p). 
Moreover, the von Neumann entropy is not decreased by a reduced description, unlike 
the Shannon version. Thus S(p) is the correct concept to represent physical entropy 

If we are given information about which to has occurred, the probability on Q, 
called the prior, changes. Suppose that p is the prior. If the information is that the 
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sample lies in a known subset (event) C O, then Bayes's theorem on conditional 
probability is used; the conditional probability is 

This is called the posterior probability, and correctly describes the probability among 
outcomes all of which lie in f^o- A conditional probability satisfies the axioms of 
probability, def. (1.1). 



This use of information to modify the probability p should not be confused with 
estimation theory. There, we do not change p, since after the measurement of in- 
dependent samples, we continue to assume that new samples are governed by the 
original p. The method of estimation using the principle of maximum entropy pro- 
ceeds as follows. Suppose that we know f2, and /, with < oo and we are also 
told the average of / over a number of independent trials. We can vary p over the 
simplex E(O) to find the point that maximises the entropy of the probability, given 
the observed mean value, rj say. Thus we use the method of Lagrange multipliers to 
maximise 

- 1 °s(p(^)) subject to E p [f] = ry. 

Gibbs knew that the solution to this is 

P H = Z- 1 exp(-/3/H), (16) 

where Z = J2u e~^^ u ' , is the Lagrange multiplier for the normalisation condition 
^2p(uj) = 1, and is called the partition function. The parameter (3 is the Lagrange 
multiplier for the condition p.f := E p [f] = 77, and is determined by it. Then ([!(]) is 



the least prejudiced estimate for the probability, given the mean ][L(J, 11]. 

The method of maximum entropy solves an important problem in the theory of 
estimation. Let X be a variate of which the distribution is known to be one of a 
family, M = {pri{i)}r>£R', we hope to estimate r\ by measuring X independently m 
times. An estimator f is a function of the data x\,X2, ■ ■ ■ ,x m that is used for this 
estimate. Thus / is a function of X, and so is a random variable. Since we do not 
know rj, to be useful, the estimator must be independent of rj. We say an estimator 
is unbiased if its mean is the desired parameter, thus: 

Pvf := '52Pv( i )f( x i) =r l- ( 17 ) 

i 

Apart from being unbiased, a good estimator should have a small chance of being 
far from the mean; so we are interested in estimators of minimum variance, V = 
Pr)-[(f — f]) 2 ]- To any probability p G A4 define the Fisher information as [12, 13] 
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We recognise this as the variance of the random variable Y = d p/drj. The Cramer- 
Rao theorem puts limits on the smallness of the variance V of an estimator /: 

Theorem 1.2 

V>G-\ (19) 
For the proof, differentiate (|l7|) with respect to 77, to get 

Now use d/dr][J2iPr](i)] = 0, and rearrange, to get 

W(^(/W-*)-l. PO) 

This is the correlation between the random variables Y and /; the (positive-semidefinite) 
covariance matrix is therefore 



(21) 



Schwarz's inequality then gives (|l9|). 

The minimum variance allowed by (p]) occurs when the Cauchy inequality is 
equality, which occurs when the factors in (g0|) are proportional (with ratio dependent 
on 77). Calling this factor —d^/drj, we see that the distribution of minimum variance 
must satisfy 

lo gftj (i) = - f dZ/&q(f{xi) - r,)dr, = - 7/,, (22) 

showing that a necessary and sufficient condition is that {p v } be the exponential 
family. 

In the case of several parameters 771 , . . . rj n , we have estimators fx , . . . , f n , which 
can be taken to be linearly independent, but need not be functionally independent. 
The state of maximum entropy, given the means E p [fi] = rji, i = 1, . . . , n is easily 
shown to be of the form 

p(u) = Z" 1 exp + • • • £nfn(u)} = Z' 1 exp(-/) say, (23) 

where the Lagrange multipliers are determined by the given conditions on the 
means. The set of probabilities of the form eq. ( |23| ) form the set A4 called the info 
manifold, or the exponential family, determined by Span{/j}. We can regard 
or indeed / as coordinates, called canonical; or we can regard {r?j} or indeed p as 
coordinates, called the expectation coordinates. In this case the Fisher information 
matrix is defined to be 

^fewgy (24) 
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Then the Cramer-Rao inequality ( pL9| ) becomes a matrix inequality, where V is the 
covariance matrix Vij : = p.[(fi — f)i){fj ~ Vj)]- Equality holds only if G = V , which 
leads to the exponential family. 



Rao showed that G defines a Riemannian metric on the tangent spaces of M [14]; 
as such, its components depend on the coordinates chosen for the tangent space and it 
transforms as a tensor under changes in variables. At the point p £ «M, a vector in the 
tangent space is given in in canonical coordinates by a random variable / in the span 
of the 'score variables' fj := fi — rjj. Writing / = J2k£, k fk introduces contravariant 
components These are dual to the 77,-, which are covariant components. The 
covariant metric is the covariance matrix 

G ij = G(flf j ) = E p [fJ j ). (25) 

It is the inverse of the contravariant G %3 , which explains why we get equality in (|l9|). 

The Massieu function t/j := log Z, where Z is the partition function, is related to 
the free energy; it is the generating function for the cumulants; so we have 

* - -§ ^ 

Gij : Vij = WW !27! 

The entropy is the Legendre transform of tp, and its second variation is the Fisher 
information matrix, G lJ , the metric in the coordinates 77. 

Amari showed that M is furnished with a pair of affine flat connections, for which 
the global affine coordinates are and rji |TI|. These connections are not metric 
connections, but are dual relative to G. An important role in information geometry 
is played by the relative information S(p\p') := ^2 w p(uj) (log p(u}) — logp'(u)). This 
distinguishes between the points p and p' in A4, in that S(p\p') > and vanishes only 
when p = p' . For a modern version, see [fit] ]. 

The observables form the algebra .4(0) in which multiplication is pointwise: 
(fg)(uj) := f(uj)g(uj); the states lie in its dual. Thus, states and observables are 
not the same kind of thing, and they transform as duals under stochastic maps. How- 
ever, states like observables are functions of to; to distinguish them we can write p(uS) 
for a state and (a;)/ for an observable. If \Q\ < 00, either can be identified with an 
element of the formal vector space spanned by O, thus: XL ot(oj)u <-> a, whether a is 
regarded as an observable or a state. Then A4 is the interior of the convex hull of 0. 
The permutation group of Q acts by right action u> 1— > uT. Its inverse u 1— ► u>T~ 1 is a 
co-action of the group (its product law is the opposite of that of the group) and so can 
be written as a left action: uj ^ Tlo := loT^ 1 . These induce a right action on prob- 
abilities, and a left action on observables, by pT{uj) := p(Tu>) and (to)Tf := (tuT)f, 
the latter written without the dual symbol *. These express associativity, as does the 
dual relation pT.f = p.Tf. 
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These definitions can be extended to any map T : VL — ► Q,, whether invertible or 
not: we define the action on probabilities using T(oS) := ({wj-T -1 ), the inverse image 
of the point-set {w}. Every algebraic endomorphism of A is of the form / i— ► Tf for 
some map T : f2 —* f2, and these make up exactly the extreme points of the convex 
set of stochastic maps. 

In infinite dimensions, there is more than one useful topology on the states and 
observables. The modern view Jl(| is that the state p and the observable — log p are 
merely alternative coordinates for a point in the info manifold. The natural class of 
charts are related by monotone, convex functions, of which the stochastic maps, [17], 
as well as the non- linear maps p i— > — logp and p i— ► p a , < a < 1 are examples. 



An active field of research is to set up quantum analogues of all this |Lq, IS, 2C. 21] 



2 From Bachelier to Wiener 

In 1900, Bachelier proposed a random model of the stock market ]p2| ; the idea was 
that the decision to buy or sell a stock is randomly taken by independent investors. 
Let us suppose that the chance A that the price goes up one unit dx is the same as that 
for going down, during any unit trading period dt. Let X £ Z be the random price, 
and p(x, t) be the probability that the price is x at time t; then the new probability 
p(x, t + dt) can be unchanged, or can change due to a movement down from x + dx 
or a movement up from x — dx. The probabilities of these are, respectively, 1 — 2A, A 
and A. Thus we get the relation 

p(x, t + dt) = (1 - 2X)p(x, t) + \p(x + dx, t) + Xp(x - dx, t). (28) 

Let T be the tridiagonal infinite matrix {A, 1 — 2A, A}. Then the row T xy , y £ Z is the 
conditional probability, that the price will be y at time (N + l)dt, given that it is x 
at time Ndt. In fact, T is a stochastic matrix, which happens to be symmetric. 

Suppose that at t = the price is xq; then in time Ndt, the price will follow the 
path 7 := xo i— > x\ ^ . . . ^ xn with probability 

p(7) = T(x , x 1 )T(x 1 ,x 2 ) ■ ■ ■ T(x N -i,xn)- (29) 

This is called the random walk on Z determined by T, starting at xq. The set of 
allowed paths starting at xo is a finite subset of Q = Z N . p(^) is a probability on 
f2, and the structure is called a Markov chain. An alternative point of view is to 
start with pq £ S(Z), and to follow the path in S(Z) given by the time evolution. 
By Bayes's law, the probability that at time t = 1 the particle is at x\ whatever its 
initial position, is p{x\, 1) = J2 XQ p(xo, 0)T(xo, x\); this can be written as the matrix 
product poT, where pt is a row vector made from the components of p(xt,t). By 
induction, the probability that at time N the particle is at x is poT N . In this way, a 
Markov chain is described by a semi-group of stochastic maps T(t) := T* acting on 
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S(A). Obviously 



r(o) = 1 (30) 

T(s)T(t) = T(s + t), s,teN. (31) 

One of the themes of probability theory is the relationship between a semi-group 
of stochastic maps and a probabiliy on the corresponding path space. The latter 
is called a dilation of the former. Since T is independent of time, the chain is said 
to be stationary; if we limit the allowed space to be a finite set A C Z, we get a 
finite Markov chain, in which case there is at least one stationary distribution p*; this 
means that p*T = p* , so that 1 is a left eigenvalue of T. If some power of T has all 
its matrix elements positive, then the Perron-Frobenius theorem tells us that 1 is a 
simple eigen- value, and all the others have modulus less than 1. One can then show 
that pT n — ► p* as n — > oo; the system converges exponentially to equilibrium. We 
then say that the dynamics is mixing. There are similar results in infinite dimensions, 
but to get exponential convergence we need to show that there is a spectral gap. This 
means that 1 is simple and lies a finite distance from the next eigenvalue of TT*. 
To prove this in the case at hand is usually the key to the study of the long-time 
behaviour. The Markov property is that the probability of getting to x at time t + 1 
depends only on where the particle was at time t, and not on the previous path. The 
study of Markov chains was started in the 19 th century, and is a huge subject. 

Fick obtained an equation similar to (|2q) for the diffusion of particles in one 
dimension. If dx and dt become small such that (dx) 2 /dt — > a, a finite limit, we 
say the system is following the diffusion limit. Rearranging, and taking the diffusion 
limit, Fick obtained the heat equation for the probability density, which we call p: 

dt~ K dx*- [6 ) 

Here, k = aX. This is not a very good model of the market; apart from the omission 
of drift, the gains in price should grow with the overall price. As it is, negative prices 
are possible. 

The heat equation (|32|) can be written in the form of a conservation law: 

|^ + divj(x,t) =0 (33) 

where j(x,t) = —nVp. At this stage, mathematicians did not have the continuous 
version of the sample space fi; this was to be Wiener's great construction. 



In his celebrated work of 1905 [23], Einstein also used (|32| ) to describe the Brow- 
nian motion of small particles in a warm liquid. He was mindful of Stokes's law of 
diffusion; this says that in a viscous liquid a small particle under a constant force, 
such as gravity, will increase its speed towards a terminal velocity v say, which is 
proportional to the force. Einstein required that in equilibrium the current vp due 
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to this flow should balance the diffusion due to the density gradient, so that steady 
state should obey 

- nVp + vp = 0. (34) 
The solution to this in the case of gravity, where v = —\v\ in the z-direction, is 

p(x,y,z) = const.e-^ 2 /*, (35) 

and this should be the Maxwell-Boltzmann law at the temperature G of the liquid, 

p(x) = Z - l e- m9z/{kB@) . (36) 

Einstein thus obtained the famous Einstein relation 

F = k B @v/K. (37) 

His treatment is not complete, since he omitted the drift term in the diffusion equa- 
tion! See §4, (1) in 22]. In a detailed study, Smoluchowski [24] wrote down the 
diffusion equation with drift 

dp dp dp 

-dt =K d^- V d- X (38) 

now known as the Smoluchowski equation, and is a special case of the Fokker-Planck 
or backward Kolmogorov equation. He solved this by using the method of images 
for several systems with boundaries, such as the mass of air above the ground, and 
obtained the approach to the stationary state expected by Einstein. 

It was known that one can solve eq. ( p8| ) exactly, to fit a more or less arbitrary 
initial function p(x, 0) = f(x), by using the Green function (in one dimension) 

G(x,t) := [Airntl-^e-^-^ 2 /^. (39) 



This satisfies eq. (38), and converges in the sense of distributions to the Dirac 5- 



function as t —* 0. Then 

p(x,t)= I G(x-y,t)f(y)dy (10) 



satisfies eq. (^) and the boundary condition. The operator whose kernel is G is the 
continuum analogue of the matrix T n of the Markov chain, 

When the force and temperature are slowly varying, we get the coupled system 

^ + divJ = 0; (41) 

— '- = ft'div VG + kF .F /ksQ- (42) 
at 

Here, J(x,t) = —K,V(p + Vp/@), where V is the potential giving rise to the force F. 
The source term in the heat equation is F.J, the power of the external force supplied 
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to the particle, all of which is converted into heat. This system obeys the first and 
second laws of thermodynamics p5| . 

Consider now the solution ( p0| ) to (|38|). Because G is positive, the density remains 
positive for all time, and the conservation law shows that the integral of p over space 
is constant. So we get a flow through the space of probabilities. The question arises, 
is there a process in continuous time associated with the Smoluchowski equation? 
The answer is yes, and this was the result of the work of Wiener, and later, Ito. An 
alternative idea was introduced by Langevin, who considered Newton's laws, in which 
a part of the external force, denoted F, is random; friction enters as a damping force 
proportional to the velocity, parametrised by 7 > 0. Thus his equation is 

^ = -&-^ + F <"- < 43) 

This is the equation for a single particle, but as F is random, the position x{t) becomes 
random as time goes by, even if its initial condition is given. Statistical properties of x 
are determined by those of F; the relation of these to the Smoluchowski equation were 
studied by Fokker and Planck, but were fully understood only in terms of stochastic 
calculus. One might assume that F is Gaussian distributed, and is of mean zero, with 
independent values at different times. This would now be described as white noise. 
Langevin's work started the enormous field of stochastic differential equations. 

In 1904 Lebesgue tried to set up a general theory in which every subset of [0, 1] is 
assigned a measure. The very next year, G. Vitale showed that the scheme was 



inconsistent 27]. Hausdorff [EH] and Banach and Tarski, showed that the measure 
could not be additive p9|] . The point is that some sets are so bad they cannot be 
assigned a measure, even a finitely additive one. This led to the concept of measurable 
set. Let us start with the Borel measurable sets on [0, 1]. 

Let fi = [0, 1]; let us say that a collection B of subsets of Q form a tribe if 

1. n g b 

2. whenever B £ B, we have B c := O, — B € B; 

3. whenever A £ B and B 6 B, we have A U B 6 B. 

Such a collection of subsets is also called a Boolean ring, or a Boolean algebra. The 
collection B is actually a ring, with multiplication given by intersection, and addition 
given by symmetric difference, that is A + B := A U B — A n B. It is also an algebra 
in the technical modern sense, but trivially in that any ring is an algebra over the 
field consisting of two numbers, and 1. Since this ring structure plays no role in the 
theory, we prefer not to furnish B with the extra structure '+', and will use the word 
'tribe' instead. 

We define a cr-tribe to be a collection B of sets B{ C O such that 3. above is 
replaced by 

3oo. if Bi E B is a countable family of disjoint sets, then U Bi £ B. 
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The set of all subsets of a set 0, = [0, 1] is obviously a cr-tribe, and indeed satisfies 
uncountable additivity as well. This cr-tribe is called the power set of Q. But, as we 
saw, there are no useful definitions of measure on the power set. Another easy case 
is the collection of all countable subsets of Q: the union of a countable collection of 
countable subsets is countable. However, any countable set has length zero, since it 
can be covered by a sequence of intervals of length < e/2, e/4 e/8, . . ., of total length 
e. Since e can be anything, the set has length zero. To get some sets of non-zero 
length, let us consider the tribe Bo of all finite disjoint unions of open, closed and 
half-open intervals. We could add to Bo all countable unions of sets in Bo, and all 
complements in Q, of sets in the tribe so obtained. Call this B\. Then we would need 
to consider the collection of countable unions of sets in B\, and their complements, 
to get a new tribe B2, and so on. Does this end up with a well-defined cr-tribe? The 
following argument does the trick. Let Q be any cr-tribe containing all sets in Bo, and 
let C be the set of all such cr-tribes. Then C is non-empty, as it contains the power 
set at least. Then form 

B=f]G. (44) 

gee 

That is, B contains those subsets of SI that lie in all cr-tribes Q, and no other subsets. 
In particular, B contains all subsets in Bo, B\ etc. In fact, by using the techniques of 
set theory, one can prove that B is smallest cr-tribe containing all the open intervals 
in 17 = [0, 1]; it is called the Borel tribe. One can ask whether we have arrived at the 
power set after all, or have something without the pathological sets. That B contains 
only nice sets follows the construction of a countable measure on its sets, namely the 
Lebesgue measure. 

A finitely additive measure on a tribe B is a map fi : B — > R + U {+00} such that 

H{A 1>B) = n(A) + /J,(B) for all disjoint A, B e B. 

If /x(O) = 1, it is a finitely additive probability measure. To do analysis, we must be 
able to take some limits, and so we now assume that B is a cr-tribe. 
A probability measure on (£l,B) is a map /x : B — ► R + such that 

1. fi(B) > for all B € B; 

2. fx(n) = 1; 

3. if Bi is a countable collection of disjoint sets in B, then 

i 

Considering the tribe Bq of finite unions of disjoint open, closed and half-open inter- 
vals, we can define the Lebesgue measure of B £ Bo to be the sum of the usual lengths 
of the intervals involved. It is then proved that there is a countably additive measure 
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on the Borel cr-tribe, which agrees with the length on the intervals. This measure is 
called the Lebesgue measure. 

It is sometimes useful to extend the concept of measure to unbounded sets such 
as R, whose total length is infinite. For this, we just drop axiom 2. above. 

So much for the measure; integration theory needs a remark as well. Suppose 
that we have a function y = f(x), where x 6 [0, 1] and y is real-valued and bounded, 
and we seek a way of finding the area under the graph of y against x. In Riemann's 
method of integration we divide the x-axis into a large number of small intervals, 
[0, xi], (x±, X2], • • • , (xjy, 1], and define yi to be the smallest value of y in the interval 
(xi,Xi+i] and Yj to be the largest value. Now define the two approximations to 
the area, known as the upper sum and the lower sum, R + = ~~ x i) an d 

R~ = J2iUi{ x i+i ~ x i)- As we refine the subdivision, R + decreases and R~ increases. 
If the limits of these are equal, we say that the function is Riemann-integrable, and 
take their common value as the area under the curve y = f(x), < x < 1. One shows 
that continuous functions are integrable, and can establish the fundamental theorem 
of the calculus; a generalisation, called the Riemann-Stieltjes integral, can be defined, 
if we replace Xi + \— X{ by P{xi + \) — P(xi), where P is an increasing function of bounded 
variation, continuous from the left. We write the integral as / y(x)dP(x). To define 
the integral of unbounded functions, various limiting methods were invented. The 
theory is not really satisfactory. 

Lebesgue introduced a new form of integration: compared with Riemann's method, 
it is done the other way round. As the first step, only positive functions are consid- 
ered. Then, we divide the y-axis into intervals ([0, yi], (2/1,1/2], ■ ■ • , (vn, 00)), and for 
each interval, look for the inverse image of each interval under the map /. That is, we 
consider the subset of the x-axis consisting of x such that f(x) G (yi,yi + i\. This set, 
denoted by j/i+i] := Bi, may consist of many pieces, and so will not always be 

an interval. We require, however that it should be a set in the Borel cr-tribe £>; if this 
holds for every subdivision of the y-axis into intervals, we say that the function / is 
B-measurable. The set R>i will have a 'length', namely, its Lebesgue measure, fi(B>i). 
We approximate the area under the graph of / by the sum 



This is positive and increases as we refine the partition of the y-axis. If its supremum 
over all partitions is finite, we say that / is Lebesgue-integrable, and write 



We can integrate functions that are not positive, provided that the positive and neg- 
ative parts are separately integrable, and we integrate complex functions by treating 
the real and imaginary parts separately. This generalises the Riemann integral in 
that any Riemann-integrable function is Lebesgue integrable, and then both versions 
give the same answer. 



L(f) :=$>/z(Bi). 




(45) 
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Lebesgue integration has the following easy generalisation, which is important for 
probability. Suppose that ft is any set, provided with a a-tribe B; the pair (£l,B) is 
called a measurable space. A real-valued function is said to be immeasurable if the 
inverse image of every open interval lies in B: 

f~ 1 (yi,y2) ■= W G n : yi < f(u) < y 2 } G B. 

A random variable is then simply a real- valued ,6- measurable function on Q. Given 
a measure \i on (£1,13), not necessarily of finite total measure, we can regard as the 
same random variable / two that differ only on a set of /x-measure zero; they are 
called versions of /. The set of all bounded random variables forms a commutative 
algebra A(£l) with norm ||/||oo := m f sup^ |/(o;)|; here, inf is taken over all versions 
of /. The sets in B are called events. The integral of a positive measurable function 
(with respect to the measure ji) is defined similarly to the case when VL = R. If jj, is 
a probability measure, this integral is called the mean [i.f of / in the state ji. and 
if n\f\ < oo we write / G L l (£l,B, fx). More generally, we write / G L p (£l,B, fj,), 
1 < p < oo if / is ^-measurable and \f\ p is integrable. These are Banach spaces 
with norm ||/|| p := (/ \ f(uj)\ p d^) l / p . The probability of an event B is taken to be 
n(B). Each measure fi defines an element of the dual space of A by the linear form 

We have remarked that the original motivation for introducing the a-tribe was 
to avoid pathology. However, the concept has been very useful in a heuristic way, 
to describe the information carried by events and observables in a random theory 
based on a measure space (£l,B,fj,); in particular, it is useful to consider a sub-tribe 
or sub-a-tribe, of B. Suppose that B G B is an event; it is determined by its indicator 
function, Xb( w ) which is 1 if u G B and zero outside B. If n(B) / 0, 1 and / is 
measurable, we can define the conditional expectation 

E[f\B]=Y J f(u)^u\B). (46) 

Ul 

We may also find the conditional probability of A G B, given that B did not happen: 
n(A\B c ) = /j,(A n B c )//i(B c ), and the corresponding conditional expectation 

E[f\B c \=Y J f("M"\B c ). (47) 

u> 

We may regard the pair of numbers, {-Ef/I-B], i?[/|i? c ]} as defining a simple mea- 
surable function on Q, equal to E[f\B] if lj G B and to E[f\B°\ if uj ^ B. Let us 
now generalise this idea. Let B\, . . . , B n G B be disjoint measurable sets such that 
^i(Bj) / for all j, and fi(\JjBj) = 1. These sets generate a tribe, say Bo (by various 
unions; there are 2 n such unions). If / is measurable, the functions on £l defined by 

F f (u) = E[f\B j ] ifueBj (48) 
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are measurable relative to Bq. They take constant values, E[f\Bj] on each Bj and so 
can be written 

F f (u) = Y^Xj{u)c3 where Cj = E[f\Bj]. (49) 

3 

Conversely, every function F, measurable relative to Bo, has this form for some {cj}. 
The map, / i— > Ft, is linear and is called the conditional expectation of / given Bo. 
This map leaves invariant the vector space of £>o-measurable functions, and indeed is 
the orthogonal projection of L 2 (Q,B, fj,) onto L 2 (J7, Bo, fj,). 

The tribe Bo tells how fine was the division into the sets Bj, and determines how 
much detail can be obtained from the functions that are /3o- measura ble. From the 
fact the F is the orthogonal projection, we see that E[f\Bo] is the best approximation 
(in the L 2 -sense) to / by functions that are ,80-measurable. 

Consider for example the price of a stock at time t, where t is a non-negative 
integer; S(t)t>o are then a family of random variables on f2, and while we can find 
out the prices up to the present time, we cannot know the future. Suppose that t = N 
is the present. The information contained in the knowledge of the prices at N + 1 
previous times, namely S(t = 0) = so, S(t = 1) = s±, . . . , S(t = N) = sjy, selects in 
fl a particular level set of these functions: this is the event 

{coeQ: 5(0)(cj) =s ... S(N)(u) =s N } 

Since we assume that S(t) are ^-measurable, this set lies in B, by the intersection 
property. The same for any other possible set of values of these observations. There 
is a smallest cr-tribe with respect to which all these functions are measurable, and in 
fact, this cr-tribe is generated by all the level sets described above. Call this B<n- The 
set of all random variables that are i3<jv-measurable is exactly the set of functions 
of the data 5(0), . . . , S(N), measurable in the Lebesgue sense; they can therefore be 
computed from the data we have access to. 

The increasing family {B< n } is called the filtration generated by the process. It 
provides a neat formulation of the Markov condition for a process X n ; let B n be the 
cr-tribe generated by the r. v. X n . Then a process is called Markovian if 

E[X n \B< m ] = E[X n \B m ] if n > m. (50) 

The idea is that the information contained in X m , the present value, tells us as much 
about the future as the whole previous history. Consider again the semigroup {T n } 
of stochastic maps, acting on E(Z) in one time-step as in eq. (|28|). One can check 
that if po is the initial probability distribution of the initial point of the path, then 

Po T n = E Pn [x n \Bo\. (51) 

Here, 7 = (x Q , ... ,x n ) and p n {l) = Po(xo)p(j) where p(j) is as in (||). 

Wiener |30| was able to put the Bachelier-Einstein diffusion theory on a rigorous 
footing. He has to define, first, the sample space f2; then he needs a u-tribe B 
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and a measure on it; he also needs a family of ,8-measurable functions Xt(to) whose 
distribution has density of probability equal to p(x, t) obeying the diffusion equation. 
Finally, he needs to get the continuum version of eq. (^j). 

Let Q be the set of all continuous functions to of t > with u>(0) = 0; these are 
called 'Brownian paths'. Let (xi,y\) be an interval of the real line, which we call a 
gate; we now consider the subset of paths which pass through the gate at time t\. 
This set is called the cylinder set based on (xi,yx). In symbols, it is 

{lo G $7 : xi < co(ti) < yi} 

The cv(t) for various t are coordinates of the point u; we have a condition on only 
one of the coordinates; the rest run over the real line. Consider another cylinder set, 
similarly constructed at time t2 > ii, based on another open interval {x2,y 2 )- The 
intersection of these sets is a cylinder set based on rectangle (x\,yi) x (x 2 ,y 2 ) in the 
plane made by the coordinates u>(ti), u>(t 2 ). The path uj{t) passes through the first 
gate at time t\ and the second at time t 2 ] it is a slalom. Consider the collection of 
subsets of consisting of all these cylinder sets defined by slaloms with any finite 
number of gates, at any selection of different positive times. The finite unions of 
these form a tribe. The smallest u-tribe B containing all these is the one we choose, 
so obtaining the measurable space ($!,£>). 

We first define a finitely additive measure on the tribe of cylinder sets. It is enough 
to give the measure of a general cylinder set, and to use the finite additivity. Starting 
at x = 0, the probability density that a diffusing particle reaches x\ at time t\ is 
taken to be the Gaussian given by the Green function; thus the probability of lying 
in the interval x\,y\ is 

PiobMti) G (s llW )K0) = 0} = (47 J i)1/2 £ e^l^dx 

ryi 

= / G(x,h)dx. (52) 

J Xl 

The probability that the path goes through two gates, (xi,yi) at t% and (^2,2/2) at £2 
is defined to be 

Prob{w(ti) G (xi,yi) and u(t 2 ) G (x 2 , 2/2) |<^(0) = 0} 
ryi nn 

= dx dx'G(x,t 1 )G(x' -x,t 2 -h). (53) 

J Xl J X2 

This can be interpreted as Bayes's theorem, in which G is the conditional probability 
density. Similarly, the probability of any cylinder set, based on a finite set of gates, 
can be given. The probability is the same, whether the gates are open, closed or 
half-open. We would like the measure we are constructing to be at least finitely 
additive. Thus we take the measure of the union of two disjoint cylinder sets to be 
the sum of the measures we have just given them individually. A possible problem 



20 



arises if we add together infinitely many gates at time t\ to make up the whole line; 
for, we would like our measure to be countably additive, and we need the consistency 
condition between the two ways to define the probability of reaching the gate (x 2 , y 2 )'■ 
from directly, with no gate at t\, as given by eq. (^), or as the sum over all paths 
going through any complete set of disjoint gates at t\, as got by summing eq. (|53|), 
Indeed, we do get the same answer, because of the propagating property of G: 

/oo 
dx G(x - x', h)G(x' -y,t 2 - h) = G(x - y, t 2 ). (54) 
-oo 

This is a continuous version of the obvious property of the stochastic matrices T n 
of a Markov chain, namely T m T n = T m+n , in which the matrix product, expressed 
as the sum over an intermediate index, is replaced by the integral over the point x'. 
Thus our equation just expresses the semi-group property of the time-evolution of a 
first-order equation, here the heat equation. It is seen here as the main point which 
establishes the additivity of the finitely additive measure we have constructed on the 
tribe of cylinder sets. 

Let us define B[ s ^ as the cr-tribe generated by the cylinder sets labelled by times 
in the interval [s,t], and B that generated by all of these. Then Wiener proved that 
there exists a unique measure on the measurable space (O, B) that coincides with 
the measure above on the tribe of unions of such cylinder sets. This measure is now 
called Wiener measure. The Wiener process starting at is then the family of random 
variables defines by Wt{ui) ■= oo(t), t > 0. The process has the following properties: 

1. Wt — W s is Gaussian with mean zero and variance t — s, for t > s. 

2. W t - W s is independent of W v - W u if < u < v < s < t. 

3. W = 0. 

These properties characterise the process. By requiring that Wq = x we get the 
Wiener process Wf starting at x £ R. 

We now need the concept of the symmetric Fock space T(H) of a Hilbert space 
TL. The n-fold tensor product ® n TL is the completed span of the symbols <8>f =1 V ; i = 
■01 <g> ... ip n with the scalar product 

n 
i=l 

The symmetric tensor product 7i n := is the subset of symmetric tensors, called 
the n-particle space; the zeroth tensor power is taken to be C. The Fock space T(TC) 
is the direct sum (B^ =0 7i n . This has the functorial property 

r(Wi) ® r(H 2 ) = r(Hi) e r(n 2 ). 

As a special case, T(C) = C © C © . . .. 
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There is a unitary map L 2 (Q, B, fi) — > T(L 2 ([0, oo), dt), in such a way that ©™ =0 H J 
is identified with the L 2 -completed span of the polynomials in W% of degree < n [31]. 



The n-particle space is then identified successively by Gram-Schmidt orthogonalisa- 
tion with the part orthogonal to the fc-particle spaces, k < n. This is Wiener's chaos 
expansion [32|. In particular, the one-particle space is spanned by {Wt}t>o- 



For each fixed t, the space L 2 (Q,B, /j,) contains the random variables I, Wt, 
...W t n ...They can act as multiplication operators successively on the vector 1, to get n 
vectors. Suppose we orthogonalise them by the Gram-Schmidt procedure. Since Wt is 
Gaussian, we get the Hermite polynomials in successive spaces, and any L 2 function 
of Wt has a convergent expansion as a sum of its components in these spaces. The 
subspace we get can be identified as the Fock space over the one-dimensional space 
spanned by Wp We shall see that these polynomials are Wick-ordered powers [33] of 
Wt, and that they are martingales. 

Now suppose that u > s; since W u is independent of W u — W s , and they are 
Gaussian, they are orthogonal in the one-particle space, which can thus be written 
as the direct sum L 2 ([0, oo), dt) = L 2 ([0,s),dt) © L 2 ([s, oo), dt). By the functorial 
property of Fock space, we therefore can write 

L 2 (n, b, n) = l 2 {vl, s [M , n) ® L 2 (n, b> s , /*). (55) 

We can similarly split Fock space into arbitrarily many factors, corresponding to any 
partition of the time axis into intervals: it has the property of a continuous tensor 
product. 

The continuous analogue of the semigroup {^T n ) m := 'y m +n, m, n = 0, 1, 2 . . . of 
the random walk is the left-shift of the paths: (u>T s )(t) = uj(s + t). This induces the 
dual action on the observables: 

T* : L 2 (n,B,n) -» L 2 (Q,B> s ,fi), s>0. (56) 

This operator is isometric but not invertible. We can also embed L 2 (Q,B, fi) in the 
two-sided space T(L 2 (— oo, oo)), on which the left shift is unitary, and induces the 
action of the group R rather than the semigroup R + . In that case the paths are not 
conditioned to pass through the origin, and only the differences, Wt — W s make sense 
as vectors or operators. 



3 The Quantum Leap 

The remarkable discovery of matrix mechanics by Heisenberg in 1925 is comparable 
to that of the theory of relativity in 1917. Clifford had speculated that the world 
might have chosen a geometry other than Euclidean. It was agreed that it was an 
experimental question, and that the data agreed with Einstein's theory. Though the 
classical axioms were yet to be written down by Kolmogorov, Heisenberg, with help of 
the Copenhagen interpretation, invented a generalisation of the concept of probability, 
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and physicists showed that this was the model of probability chosen by atoms and 
molecules. 

According to Einstein et al. |34j a concept is deemed to be an element of reality 
within a specified theory if there is a mathematical object in the theory which is 
assigned to the concept, and which takes a definite value (when the state of the 
system is given). This is now called an observable. For example, the choice of the 
zero-level of a potential function, is not an observable since it is not determined by 
the state of the system. They are not here discussing random samples, which at 
the time would have been described as an ensemble. In that case, they might have 
conceded that a concept could be regarded as an element of reality if, in a random 
selection of the system from an ensemble, there is a definite random variable assigned 
to the physical concept. The interpretation of a theory is not complete unless it is 
specified at the outset which mathematical objects arising in the theory correspond 
to observables. Thus in a theory with randomness in classical physics, there is a 
space (£l,B) and an observable is a random variable, and an ensemble is a probability 
measure on fi. A non-random state is given by a point-measure. In this state any r. 
v. has zero variance, thus satisfying EPR. 

In quantum mechanics, this is not the case; an observable is a Hermitian matrix 
A, or in modern terms, a self-adjoint operator on a given Hilbert space H.; the possible 
values one can find in a measurement are the eigenvalues of A. A wave- function is 
determined by a vector rp € Tl; but only unit vectors are used, and e l8 ip represents 
the same state as tp. Thus the state is the equivalence class {ip} = {e ia ip,a S R}. If 
dimW = n < oo, such equivalence classes make up the projective space CP n_1 . An 
element of CP n ~ l determines the expectation value of any observable A by (ip,Aip), 
which according to the Copenhagen interpretation, is the mean value of A if measured 
many times in the state {ip}. It is seen to be independent of the representative vector 
ip S {ip}. Such a state is called a vector state. The concept of state was generalised 
by von Neumann to include random mixtures of vector states . Let B(7i) denote the 
set of bounded operators on H; this is a complex vector space, and also *-algebra, 
where conjugation is given by the adjoint and multiplication is the usual product 
of operators. A state is given by a positive operator p of trace 1, called a density 
operator, and the expectation of an observable A is taken to be m\{A) := Tr(p^4). 
Any density operator determines an element of the dual space to B(TC) by the map 
A i — > mi (A). We also can define m n {A) := pA n to be the n th moment of A, and 
K2(A) := m2(A) — mi(A) 2 to be the second cumulant, the variance, uncertainty or 
dispersion of A in the state p. von Neumann showed that there are no dispersion-free 
states. Thus, quantum mechanics is intrinsically random. Heisenberg's uncertainty 
relation, which is a theorem, not a postulate, is the best-known facet of this: 

Theorem 3.1 Let A,B,C G B(H) be such that [A,B] := AB - BA = C ; then in 
any state p, we have K2(A)k2(B) > mi(C) 2 /4. 

There is no uncertainty relation for commuting operators A, B, and such observables 
are said to be compatible. If [A, B] ^ 0, we say that A and B are complementary. 
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Segal has emphasised that the bounded observables in any quantum theory should 
form the Hermitian part of a C*-algebra with identity. This is a complex vector space 
A with 

1. a product AB is defined for all A,BeA, which is distributive and associative, 
but not necessarily commutative; 

2. a conjugation A^ A* , which is complex-antilinear, is specified; 

3. A is provided with a norm || • || which obeys Gelfand's condition 

\\A*A\\ = P|| 2 ; (57) 



4. A is complete in the topology given by this norm. 

This concept includes all the examples we have seen so far; the set A4 n (C), denoting 
n x n matrices, with matrix addition and product, is a C*-algebra. The * operation is 
Hermitian conjugate, and the norm || A\\ is the maximum eigenvalue of \ A\ = (A* A) 1 / 2 . 
For any Hilbert space, B(TL) is also a C*-algebra, and more generally, so is any von 
Neumann algebra, which can be defined as any weakly closed *-subalgebra of B(TC) 
containing the identity. Another notable example is the subset C(n) of Ai(n) con- 
sisting of real diagonal matrices A = diag (a±, . . . ,a n ). This is clearly commutative, 
and the diagonal elements are the eigenvalues. Thus, each A £ C determines uniquely 
a function i i— > a^, 1 < i < n from the set f2 n = (1,2, ... ,n) to R. Conversely, 
any random variable / on f2 n defines a unique diagonal matrix diag (/(l), • • • , /(«))■ 
So the classical observables on il n can be described as a special type of quantum 
mechanics, namely, the diagonal matrices. Moreover, the interpretation in classical 
theory, of the values of the random variables / as possible observed values, coincides 
with the quantum interpretation of the eigenvalues. Also, each n x n density ma- 
trix p defines a unique probability measure p on S7 n , by using the diagonal elements: 
p(i) = pa, 1 < i < n. Clearly, a probability p can define a density matrix by the 
same formula, but there are other, non-diagonal density matrices giving the same p. 
If all the observables are contained in C, then the off-diagonal elements of the density 
matrix are of no relevance, and all the information on the state of the system is con- 
tained in p. A concept that captures the essentials of this idea, removing redundant 
description, is due to Segal. Given the algebra of observables, A, we say a state on A 
is a positive, normalised linear map p : A — ► C. Thus 

1. p is complex linear; 

2. p(I) = 1; 

3. p(A*A) > for all A G A. 
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Naturally, two constructions that lead to the same map are said to define the same 
state. We should note that we only need the expectations, i.e. the first moments, 
of the observables, because A itself contains all powers of A, and (as it is complete), 
also elements such as e lA ; so if we know the state we know the characteristic function 
of every observable, and so its distribution too. 

More generally, the classical measure theory (Q,B,p,), where \i is a positive mea- 
sure, can be written as a (commutative) quantum theory by using the von Neumann 
algebra p) acting as multiplication operators on L 2 (Q,B, p); its normal states 

correspond to (countably additive) probability measures, which vanish on /u-null sets. 
Indeed, given a state p we can define the corresponding measure of a set B G B as 
p{Xb)- I n this, sets B and B' are indistinguishable if the differ by a ^-null set; we do 
not really need f2 itself, but only the u-tribe £>, modulo this equivalence. 

The set of states of a C*-algebra A forms a convex set, which we shall call E(«4) 
or just E. The convex sum 

p = Api + (1 - X)p2, where < A < 1 (58) 

represents the random mixing of the states p\ and p2 with weights A and 1 — A. All 
expectations in the state p are then the same mixtures of the expectations in the 
states pi and p%. If p\ ^ p2 we say that p is a mixed state. If p cannot be written 
as a mixed state (so that in any relation such as eq. (|58|) we must have p\ = P2), the 
we say that p is a pure state. Every C*-algebra possesses many pure states. For the 
full matrix algebra M n , every pure state is given by a unit ray {ip} in the Hilbert 
space C n , using the usual quantum- mechanical expression; every density operator is 
a mixture of such. This is an example of the Krein-Milman theorem, which says that 
a weak*-compact convex set in the dual of a Banach space is generated by its extreme 
points. The representation of a mixed state as eq. ( |58|) is, in general, not unique. 
For example, if TL = C 2 , the fully unpolarised state is (1/2)/, and this the equal 
mixture of the pure states, the eigen- vectors of J3, the spin operator in the direction 
of quantisation, as well as the equal mixture of the eigenstates of J\, or any other 
spin direction. This means that all statistical properties of the observables are the 
same however the state was made up. We express this by saying that the state-space 
in quantum probability is in general not a simplex: in a simplex, any mixed state has 
only one decomposition into pure states. In classical probability, in contrast, the state 
space E(f2) is a simplex. This is true in quantum probability only if A is abelian. 
The density matrix contains all the information there is. Our inability to distinguish 
the history of how the state was made is due to the quantum phenomenon of coherent 
sums of wave- functions. 

There is an important connection between states and representations of a C*- 
algebra. A representation ir of A is a *-homomorphism from A into B(7i) for some 
Hilbert space Ti. Thus, ir(A) is an operator on Ti and the map ir satisfies, for all 
A,B €A, 

1. ir(\A + B) = Xtt(A) + tt(B), for all A G C (linearity); 
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2. it {A*) = (it (A))* (hermiticity). 



A representation is said to be faithful if tt(A) is non-zero if A ^ 0. A state p is said 
to be faithful if p(A*A) = only for A = 0. To each state p there is a representation 
7T p , on a Hilbert space Ti. p , and a unit vector ip p £ TC P , such that p is vector state 
that is, 

p(A) = (ifrp,TTp(A)ij)p), A £ A. (59) 

If the state p is faithful, then so is the corresponding representation ir p . Moreover, n 
is irreducible if and only if p is pure. 

The proof of this theorem, which asserts the existence of 7i p and the homomor- 
phism 7Tp, follows the common mathematical trick: we construct these objects out of 
the material at hand. Let us do this when A has an identity and p is faithful. We 
start with the vector space A and provide it with the scalar product 

{A,B) :=p(A*B). 

The completion of this space is then taken to be 7i p . The operator tt p (A) is taken 
to be left-multiplication of A by A, thus: tt p (A)B := AB. This defines tt p (A) on the 
dense set A C TC pi and can be shown to be bounded. We take ip p = I, the identity 
in the algebra. One can then verify that (Ti p ,7r p ,t() p ) satisfy eq. (|59[). A slightly more 
elaborate construction can be given if there is no identity or the state is not faithful. 
This realisation of the algebra is called the GNS construction, based on p. 

It took some time before it was understood that quantum theory is a generalisation 
of probability, rather than a modification of the laws of mechanics. This was not 
helped by the term quantum mechanics; more, the Copenhagen interpretation is 
given in terms of probability, meaning as understood at the time. Bohr has said 
p5[ that the interpretation of microscopic measurements must be done in classical 
terms, because the measuring instruments are large, and are therefore described by 
classical laws. It is true, that the springs and cogs making up a measuring instrument 
themselves obey classical laws; but this does not mean that the information held on 
the instrument, in the numbers indicated by the dials, obey classical statistics. If the 
instrument faithfully measures an atomic observable, then the numbers indicated by 
the dials should be analysed by quantum probability, however large the instrument 
is. 

We now present Gelfand's theorem, which shows that any commutative quantum 
theory can be viewed as a classical probability theory. We give a proof in finite 
dimensions. 

Theorem 3.2 Given a commutative * -algebra C of finite dimension, there exists a 
(finite) space f2 and an algebraic * -isomorphism J from C onto A(£l), such that for 
any state p on C there exists a probability p on Q, such that for any element A £ C 
we have 

p(A) = E p [J(A)}. (60) 
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Proof 

Since dimC = n < oo, the dimension of the dual space is the same. There is a faithful 
state <jj on C; this could be for example a mixture of a basis of the state-space with 
non-zero coefficients. We can therefore construct a faithful realisation of C as a matrix 
algebra. In this, the GNS construction, the Hilbert space is built out of C and so is 
of dimension n. A commutative collection of normal matrices can be simultaneously 
diagonalised, so there is a basis in the Hilbert space such that each element of C is a 
diagonal n x n matrix. Since exactly n of these diagonal matrices make up a linearly 
independent set, every diagonal matrix appears. Every element of C is therefore a 
sum of multiples of units {ej} of the algebra, satisfying ej = ej and e^ej = 0, i ^ j. 
In the above matrix realisation, ej is the matrix with 1 on the diagonal in position 
j, and zero elsewhere. Thus A = J2 a j e j- So let = {ej}j=i t ,„ n , and let J A be the 
function JA(e.j) = aj. Then one verifies that J is an algebraic ""-isomorphism. To the 
state p we associate the probability p(ej) = p{ej), and see easily that eq. ( |60| ) holds. 
□ 

In this proof, instead of identifying Q, with the collection of elements ej in the 
algebra, we could have taken the dual, and identified f2 with the set of characters on 
C. This is the set of multiplicative states, that is, states u obeying co(AB) = uj(A)uj(B) 
for all A, B £ C. The set of characters of a C*-algebra is called its spectrum. Our 
proof shows that there are exactly n of these, defined by ujj(ek) = Sjk- Putting A = B 
we see that any character is dispersion-free. This is why the spectrum is taken by 
Gelfand to be the definition of in the infinite-dimensional case: 

Theorem 3.3 Let C be a commutative C* -algebra with identity. Then the set of 
characters can be given a topology so as to form a compact Hausdorff space 0, such 
that C is C* -isomorphic to C(Q), and every state on C corresponds to a finitely additive 
measure on 0, (with the Borel tribe). 

Bohm asked whether the observed statistics, agreeing with experiment, can be 
obtained from a larger, more complicated classical theory. This is the idea behind the 
attempts to introduce hidden variables. This is certainly true of the statistics of any 
fixed complete commuting set of observables; for they form an abelian algebra, and so 
can be represented by the classical statistics of multiplication operators on a sample 
space (the spectrum of the algebra). Obviously the full non-abelian algebra cannot 
be a subalgebra of an abelian algebra, so the way hidden variables are introduced 
must be more elaborate than extending the algebra by adding them. However, the 
deep result of J. S. Bell shows (if the dimension is 4 or higher) that the full set of 
statistics predicted by quantum theory cannot be got from any underlying classical 
theory. In the quantum model of two spin-half systems, Bell constructs a sum of 
four correlations which in a certain state is equal to 2^/2, a factor y/2 larger than the 
greatest value allowed in any classical theory. 



Let us follow |36|, 37|. Let P, Q be complementary projections, and also let P',Q' 



be complementary projections, while P is compatible with P' and with Q' , and Q is 
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compatible with P' and Q' . Define a = 2P — I, b = 2Q — I, and similarly for a' and 
b'. For any state p define R by 



R := p{aa! + ab' + W - bo!) = p{C) 



where C = a{a' + b') + b(b' - a'). Then a 2 = b 2 = a' 2 = b' 2 = 1, so 



C 2 



4 + [a, b] [a', b'] = 4 + 16 [P, Q][P' , Q']. 



(61) 



Since II a 





1, it follows that 



[a,b}[a',b'}\\<4, 



so C 2 < 8 and |i?| 2 = |p(C)| 2 < p{C 2 ) < 8. So in quantum theory, \R\ < 2^/2. 
If there is a joint probability space on which we can describe a, . . . ,b' by the r. v. 
f,...g' taking the values ±1, and a measure p on it, then R = E p [h] where 



So \R\ < 2, (Bell's inequality). Bell showed that the entangled states of the Bohm- 
EPR set-up give a p such that R = 2^2, violating this. Thus no description by 
classical probability is possible. 

The famous Aspect experiment tested Bell's inequalities. This involves observing 
a system (in a pure entangled state) in a long run of measurements; the correlations 
singled out by Bell, between several compatible pairs of spin observables, were mea- 
sured. The experiments showed that R was just less than 2^/2, in agreement with the 
quantum predictions. 

The upshot is that in quantum probability there is no sample space; we have the 
C*-algebra A, and this plays the role of the space of bounded functions. 

Let us now examine Bohm's claim that there is a hidden assumption in Bell's 
proof, that of 'locality'. It is now generally agreed that the term 'local', referring 
to the space- localisation, is not the best, and that 'non-contextual' is a better term; 
namely that the choice of random variable / assigned to represent a certain observable 
a which is being measured, does not depend on which of the other observables, a' or b', 
is being measured at the same time. This is now called a non-contextual assignment. 
Bohm suggested that we should allow a contextual choice of assignment of random 
variable, so that the r.v. representing the observable a when a' is also measured is 
not the same as the choice of r.v. for a when it is measured with b' . The two choices 
will, however, have the same distribution. It should be said straight away that this 
idea is contrary to the practice of probabilists, who would expect there to be a unique 
random variable representing an observable. It also goes against the definition of 



h = f(f + g')+g{g'-n 



Then these r. v. commute, so eq. ( |6ll) becomes h 2 = 4, and 

|i? 2 | = E p [h} 2 < E p [h 2 } = 4. 
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'element of reality' of EPR as extended by us to the random case. The quantum 
version does not suffer from this unreality, since the mathematical object assigned to 
the observable, the Hermitian matrix, does not depend on the context, i.e. is local in 
Bohm's language. 

Bohm's idea leads to a theory with very few rules. However there are some 
restrictions, since the choice must be done so that all statistical measurements of 
compatible observables (means, correlations, third moments etc) of the model can 
be arranged to give the same answers as the quantum theory. This is achieved as 
follows. Let a, a' be compatible, generating a commutative C*-algebra, C and let p 
be a state on the full algebra A. By restriction, p defines a state on C. By Gelfand's 
isomorphism, we can construct a space fi, the spectrum of C, and a measure p on it, 
such that a, a' can be represented as multiplication operators on C(O), so they are 
random variables, /, g. The joint probability distribution of /, g is the same as that of 
the (diagonal) matrices a, a' in the state p. On the other hand, f2, p depends on the 
set a, a'. Let us record this by denoting this Gelfand representation by Q a ,a' , fJ-a,a' ■ If 
we measure a and b' , and proceed as Bohm suggests, then we get a different space 
Q a: b' , the spectrum of a different algebra C a p , say. The state p leads to a different 
measure p a ,b'- The r.v. assigned to a cannot be / this time; it must a function on 
Q a ,b', a different space; it has the same distribution in p a p as the / had in p a)CL >. In 
this set-up, there is no obvious definition of a' + 6', as they are not functions on the 
same space. This problem does not arise in the quantum formulation: there is an 
underlying C*-algebra, in which we can add the operators. 

Bohm's suggestion might be said to be an interpretation of quantum mechanics 
in terms of classical probability [38]. However, the construction is not a probability 
theory in the sense of Kolmogorov, as there is no single sample space; the theory 
is preKolmogorovian, in the tradition of the frequentist school. One can generalise 
the frequentist point of view, and specify that certain collections of observations 
are compatible, and others are not; then we can by observation construct the joint 
probabilities of each compatible set, and have no need of the sample space (the space 
of joint values). A different compatible set need have no analytic relation to the first, 
even though it contain common observables. Bell's inequality need not hold, but then 
neither need the quantum version, which is -y/2 times more generous. It is a feeble 
theory, not much more that data collection, and has no predictive power. Mere data 
give us no more than mere data. 

Another variant of quantum mechanics, a new form of algebra called 'quantum 
logic', was developed in 3£j. New rules by which propositions can be manipulated 
are given. This was worked on later by Jauch and coworkers [fSJ, culminating in 
Piron's thesis. This says that the propositions form a lattice isomorphic to the lattice 
of subspaces in a Hilbert space (but not necessarily over the complex field). Apart 
from this result, quantum logic has not been very successful, and it is more productive 
to keep to classical logic, but to generalise the concept of probability algebra from 
commutative to non-commutative. Another alternative to quantum probability is 
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stochastic mechanics, founded but now abandonned by Nelson [41] as not being correct 
physics. Thus Segal's approach is the one we adopt here. It is well explained in 



Quantum theory has its version of estimation theory [45, 46|. In finite dimensions, 
the method of maximum likelihood is to find the density matrix p that maximises the 
entropy, subject to given values for the means, {77,} of observables in the subspace 
of hermitian operators spanned by a named list {X\, . . . ,X n } of slow variables. So 
rji = TrfpXj]. It is well known that the answer is the Gibbs state 

p = Z- 1 exp(-H) = Z- 1 exp-[e 1 X 1 + ...+rX„], Z = Tr[exp(-if)[. (62) 

Again, log Z is strictly convex, and its Hessian gives a Riemannian metric on the 



manifold M. of all faithful density operators 47, 17, 48]. In this case we get the 
Kubo-Mori-Bogoliubov metric; in terms of the centred variables Xi := Xi — r/i, the 
metric is 



g(X i ,X j ) = Tr 



f 1 p x X i p 1 - x X j d\ 
Jo 



(63) 



This is the closest point on A4 to any state with the given means, where 'distance' 
is measured by the relative entropy S(p\p') := Trpflogp — logp]. Again, the £ J are 
uniquely determined by the measured means r^. 

4 Kolmogorov and Ito 

A stochastic process over a set T is a family {Xt,t G T} of random variables on a 
measure space (SI, £>, p). We might have T = {0, 1, 2 . . .}, or T = R + , when we inter- 
pret t as time. From the frequentist point of view, we can observe Xt x , Xt 2 , . . . Xt N 
at finitely many points of time. In this way, we can test any a model as to what the 
joint distribution of these r.v. is. 

Kolmogorov's existence theorem says that a family of joint (cumulative) distribu- 
tions Fi^2... n (xi, • • • , x n ), given for all finite subsets of T, is the set of joint distributions 
of a stochastic process over T if and only if the consistency conditions hold. Thus, 
(the hatted variable is omitted): 

1. For any permutation ir of (1, 2, . . . , n), we have 

F\,...n{%l 1 ■ ■ ■ j X n ) = -f 1 7r (l) J ... J 7r(n) (^(l) > • • • ; x n(n)) 

2. For any j, we have 



F\,...,nip^i 1 • • • 1 x j — ^i+i i ■ ■ ■ ! — ^ j ^ n (xi , 



l,...,j,...,nA u ' i ' ' ' ' ' x i' • • • ' Xn >' 

If these hold, he shows that the sample space O may be taken to be R T , an 
enormous space (of all functions uj of t); the r. v. Xt is then the function Xt{oj) = uj(t). 
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He proved the existence of a measure /x, which reproduces the given joint distributions; 
the cr-tribe B has the following structure. Let Bt be the smallest cr-tribe such that all 
X s , for s < t, are measurable; then this is an increasing family of cr-tribes, called a 
filtration. Then B is the smallest cr-tribe containing all the Bt- 

Apply this to the Brownian paths, and the measures defined by a finite set of gates 
as in the last section; this proves that there is a probability theory underlying the 
finite joint distributions. However, it does not prove Wiener's theorem, in that the 
sample space obtained by the Kolmogorov construction is the huge set of all functions 
of time. It is then a hard problem to show that the subset of continuous functions has 
measure 1. This fact is very important for specialists in Brownian motion, but is not 
a general feature of processes covered by Kolmogorov's theorem, and is not needed 
to construct the usual LP spaces of functional analysis. Without Wiener's version 
we lose the power of the path-wise methods, and also lots of intuition. The modern 
method is to get the cow off the ice using Kolmogorov, and supplement it with further 
estimates, on tightness and radonifying maps, if we need to find smaller carrier spaces 
for the measure |49| , |5Cfl . After Kolmogorov's treatise, the subject could develop 'in 
the usual professional mathematical way', to use Segal's phrase. That is, theorems 
could be stated and proved, and then sharpened. The most important of these were 
the laws of large numbers, the zero-one laws, the central limit theorems, the theory 
of large deviations, the classification of all processes with independent increments, 
martingales, and stochastic integration. 

The conditional expectation E% := takes a random variable in L 2 (Q,B, /i) 

into one in L 2 (Q,Bt, fi); since it is the identity on the latter space, and is Hermitian, 
it must be the orthogonal projection onto L 2 (Q,Bt, /i). None of these ideas depends 
on which version of the sample space we have. 

The concept of conditional expectation can be extended to integrable r.v., thus: 

Definition 4.1 Let (£l,B,fj,) be a probability space, and let Bq be a sub-a-tribe of B. 
Let X be a random variable with E[X] < oo. Then there exists a Bo-measurable r.v. 
Y , written E[X\Bq\, such that for each set B 6 Bq we have 



Ydfi= / Xdfi (64) 

B JB 

Further, ifY is another r.v. with these properties, then Y = Y almost everywhere. 



See |]29[ for a proof, and other things. 

A martingale is a stochastic process X t on (fi, Bt>o, fJ>) such that X t is integrable, 

and 

E[X t \X s ] =E[X S ] for alii > s. (65) 

A martingale is a fair game. For example, consider the independent tosses of a 
fair coin, and let X n = H n — T n , where H n is the number of heads and T n is the 



number of tails at the n th toss. Let Sn = YljLi^j- Then Sn is a martingale [51], p 



202. 



31 



There are four concepts of convergence of a sequence {X^} to X in the space of 
random variables on a probability space (Q,B,fi). 

1. We say X n — » X almost surely (or, almost everywhere) if 

H{u> : X n (w) -» X(u)} = 1. 



2. We say X„ — » X in || • || r if 

\\X n — X\\ r ->0asn^oo. 



3. We say that X n — > X in probability if 

: \X n (tu) — X(uj)\ > e} — > as n — > oo for all e > 0. 



4. We say Jf„ — > X in law if 

: X„ < x} — > /i{cj : X < x} for all x at which Fx(x) := fi{X < x} 
is continuous. 

These concepts are not equivalent; (1) and (2) are not comparable, but (1) or (2) 
imply (3), which implies (4) pi]] . Convergence in law can be related to convergence 
of the characteristic functions of X n to that of X; we see that if X n converges to X 
in law implies that X n also converges to Y in law if Y has the same distribution as 
X. This shows that convergence in law in a very feeble concept. The four concepts 
of convergence do not depend on the version of sample space adopted, and so are the 
same whether we use Wiener space or Kolmogorov's abstract construction. 

For a given (jl, we can complete the cr-tribe B to include all subsets of sets of //- 
measure zero; then the events that can happen are described by the quotient c-tribe, 
in which events which differ by a set of measure zero are identified. This idea is 
not wise when we are interested in measures with different sets of zero measure, as 
happens when we condition a Wiener path to pass through a given point. The Dirac 
measure on R is a simple example of the trouble we get into. If two measures fJ>i,fJ><2 
have the same sets of zero measure in (Cl,B), we say that they are equivalent. If 
Hi{B) = whenever 112(B) = we say that [i\ is absolutely continuous relative to Hi\ 
in that case there exists a function w G B, 112) such that fJ-i(B) = f B p(u)d(j,2 

for all B £ B. We write w = d\i\jd\JL2, the Radon-Nikodym derivative. This is the 
abstract version of eq. (|i~2|). We shall be interested in other measures, singular relative 
to a given one. Then the best formalism is to start with an abelian C*-algebra A and 
consider its states. 

Estimation is assisted by the law of large numbers. Let X be a random variable 
on a probability space, whose mean r/ we wish to find, making use of a random 
experiment which is believed to be well modelled by X. We set up a sequence of 
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independent copies X n of X, and consider the stochastic process {-Xn} on e.g. the 
probability space constructed by the theorem of Kolmogorov. The strong law of large 
numbers says that if E(X) = n and E(X 2 ) < oo, then putting S n = J2jLi Sj we have 

Sn/N — > 7]I in || • 1 1 2 - 

If E\X\ < oo, we get almost sure convergence. These are necessary and sufficient 



conditions. Weaker conditions ensure that the sum converges in probability [51]. This 
is called the weak law. Note that the meaning of convergence uses the measure on the 
Kolmogorov space, so for almost all sequences, randomly chosen, we get convergence 
to the mean. It does not say how fast the convergence is. For example if X n is the 
number of heads minus the number of tails, at the n th toss of a fair coin, then Sn 
is the number of heads in N tosses minus the number of tails, and Sjy/N converges 
almost surely to zero. If we know that S m 7^ after m results, the law does not say 
that the bias evens out in the long run. S n is a martingale, and its expected value for 
N > m is its present value S m . It is Sn/N, which converges; the bias at time m gets 
divided by N, and so goes away for large N. 

Another famous limit law is the central limit theorem; if the standard deviation 
X is 1 and the mean is zero, then one can show that 

S n /{y/n) -> N(0, 1) in law. 

Versions of this were known to Bernouilli and Gauss, if we assume that the moment- 
generating function exists. It explains the ubiquity of the normal distribution; many 
random processes are the sums of small and independent random things, and so tend 
to be Gaussian. The theory of large deviations tells us something about the rate of 



convergence of S n ; this stuff is deeper [52, 53, 54, 55]. There is also a large body of 



work on sums of nearly independent random variables, and also on the cases where 
the variances are not all equal. 

Doob proved that martingales often converge; e. g., 

Theorem 4.2 If {S n } is a martingale with E(S^) < M < oo for some M and all n, 
then there exists a random variable S such that S n —* S almost surely. 

Consider now a process (Xt,Cl,Bt>o, fJ>) in continuous time with independent in- 
crements; that is, Xt — X s is independent of X r for r < s < t. Since we can write 
Xt — X s as the sum of more and more independent differences, we might expect that 
Xt — X s must be Gaussian, by the central limit theorem. However, this is not the case 
since the distributions of the difference Xt — X s might change as the interval is made 
smaller. This question led Levy to characterise all processes that are stationary and 
have independent increments. This can be done by showing that the characteristic 
function 

C(A) :=E[expi(X t -X s )X\ 

should not only be of positive type, but so should any fractional power. Such a 
function is called infinitely divisible, and so is the corresponding random variable. 
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The necessity is easy to see; we can write Xt — X s as the sum of N identical and 
independent random variables, namely, the increments for time intervals (t — s)/N; 
then the characteristic function of this sum is the product of the N characteristic 
functions (which are all equal, by stationarity) of these increments, and so C has an 
jyth roo ^ that is of positive type. This condition is also sufficient, to which we shall 
return. The characteristic function of the Gaussian is infinitely divisible, and so is 
that for the Poisson distribution. This means that Gaussian and Poisson processes 
with independent increments exist. Levy found that by mixing these he got some new 
processes (Levy processes) , and he found the most general form of the characteristic 
function, which is 

log C(X) = -aX 2 + ib\ + J da(a) [e iaX - (1 + iaX)Z(a)\ (66) 

where a > 0, b is real, da (a) > obeys j\ a 2 da{a) < oo. There are some further 
conditions on the weight da at infinity f56]| . If a = we get the Gaussian, and if a 
has a discontinuity, we get a Poisson process. These can be understood in terms of 
Hilbert space cohomology of R, as in §(5). 

During this period, physicists and engineers studied stochastic differential equa- 
tions, similar to the Langevin equation. Often the random force was chosen to be 
the derivative of Brownian motion, called white noise. Since Bt is at best continuous, 
this work lacked rigour, and remained poorly defined even after appeal to Dirac's 
generalised concept of function. This sorry state of affairs was cleared up by Ito. 

Let W(t) be Brownian motion starting at zero. At first sight, an equation for an 
unknown X(t) similar to the Langevin equation, of the form eq. ( (43| ) 

dX t i \ dW t „ , 
— : — = ait) + o — - — , for almost all u 
dt w dt ' 

makes no sense, since for almost all wgfi, W{t) is not differentiable. The equation 
does make sense if written in the form: find a family of random variables, {X(t)}, 
such that for a given initial random variable X(0), the r. v. X (t) — X (0) — Jq a(s)ds is 
the known r.v. Wt for almost all u. This does not prove that there is such a process, 
but it is does make sense. For the more general case when a, b depend on the unknown 
X(t), the integral form is 

X(t)-X(0)= [ a{s,X{s))ds+ /* b(s, X(s))dW(s). (67) 

JO J 

The last expression, called a stochastic integral, looks like a Stieltjes integral, but the 
needed condition of bounded variation on W(s) do not hold. Solve the equation by 
iteration (Picard's method); we see that at each stage, the approximation to X(t) 
is a function of W(s) only for s < t. So it would appear that we need only give a 
meaning to the stochastic integral for the cases where X(t) is a function of W(s) for 
s < t, and so the same holds for b(t,X(t)). This can be neatly put in terms of the 
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filtration Bt generated by the Wiener process: for all t > 0, X(t) and so b(t,X(t)) is 
measurable relative to the cr-tribe Bt- This makes sense physically; it says that we 
can know the present configuration X{t) if we know the initial configuration X(0) 
and the outcomes of all the randomness, W s , s < t, so far. A random function of 
time, / is said to be adapted to the filtration Bt if f(t) is ^-measurable for all t > 0. 

Let fit) be an adapted process in the time interval < t < T, which is simple: that 
is there is a finite partition = to, ti, . . . <t n = T such that f(t) = fj for tj-\ < t < tj 
for all integers j £ (1, . . . , N). Here, fj is a random variable independent of time, and 
equality of random variables means almost everywhere. Following Ito, we can define 
the stochastic integral of an adapted simple function / to be the random variable 

£ f{t)dW t := fj(Wt j+1 ~ W tj ). (68) 
Note that the increment dW is in the future of the random variable fj that multiplies 

rp 

it. The mapping, / i— > f f(t)dWt takes the linear space of simple adapted functions 
into the space of random variables, and is clearly a linear map. The brilliant remark 
of Ito is then that the following identity, called Ito's isometry, holds: 

E[\ [ T f(t)dW t \ 2 }= F E[\f{t)\ 2 ]dt (69) 
Jo Jo 

Proof: 

E[\ f f(t)dW t \ 2 ] = " W ti )f 3 {W tj+1 - W tj )\ 

= J2E[\M 2 (w u+1 -w t f 

% 

+ 2 £ fifj (W u+1 - W u ) (W tj+1 - W tj )}. 

i<j 

Now, the future increment W ti+1 — W ti is independent of fi, which is adapted, i.e. a 
function of earlier W(s). So the expectation value in the first term factorises: 

E[\f t \ 2 (W u+1 -W t f] = E[\f t \ 2 ]E[(W tl+1 -W u ) 2 ] 

= E[fi\ 2 ](ti+1 — U), 

by the property of Brownian motion. This gives the desired term in eq. (|69|). It 
remains to show that the remaining double sum vanishes. This is true, because the 
factor (Wt j+1 —Wt^ for j > i is independent of the remaining factors fifj(Wt i+1 — W^) 
and so the expectation of the product is the product of the expectations; but the 
expectation of the future increment of Wt is zero. □ 
Ito's isometry is a mapping from the set of simple adapted processes to random 
variables; by a simple theorem of normed spaces, it can be extended by continuity to 
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a linear isometry (unitary transformation) between the completions of both sides in 
the norms given. The completion of simple functions in the norm 



[ T E[\f(t)\ 2 ]dt (70) 
Jo 



is the space of processes such that -E[|/| 2 ] is Lebesgue integrable; so Ito can define 
the stochastic, or Ito integral, of all processes with this property; it is the limit in this 
norm of simple adapted processes approximating it. Naturally, we must prove that 
the adapted simple processes are L 2 -dense in the square-integrable adapted processes; 
this is not difficult, since the projection Et is a bounded operator and maps onto the 
space of £>t-adapted square-integrable processes. 

We can now give a meaning to the question, do there exist solutions to the stochas- 
tic differential equation 

d -§ = a(X t ,t) + b (X t ,t)^? (71) 

We say the a process X t satisfies this equation if, on substituting X s in the integrals 
in eq. (p7|) we get back X t — Xq. 

For a wide class of functions a and b of two variables we can then get a convergent 
iterated approximation, the Picard series, which converges to a process Xt obeying 
the (integral form of) the stochastic differential equation. This holds for example if 
a(x, y) is uniformly Lipschitz in y in a region, and b(x, y) is uniformly elliptic in y 
and measurable in x, y. This result can be improved and generalised, so that vector- 
valued stochastic processes can be studied, and the noise can be of a much more 
general martingale than Wt- This can be reworded as a 'martingale problem' |p7|] . 

The converse to Ito integration should be a form of differentiation: it is called 
(Ito) stochastic differentiation; we may say that the process f(Wt,t) is the stochastic 
derivative of J * f(W s , s) dW s . The Ito integral is always a martingale, and every 
martingale is a stochastic integral, and so has a stochastic derivative, namely the 
integrand in its representation as an Ito integral. One can show that this is unique. 
It is interesting to form the repeated stochastic integrals 

W t = f dW s 
Jo 



W? :=W?-t = 2 / ' W s dW s 



o 

: Wf : = 3 / : W fl 2 : dW s 
Jo 



in which the Wick ordered (Hermite polynomials) occurring in the Wiener chaos 
are the successive stochastic integrals. They are all contained in the exponential 
martingale e^ Xt ~i x 1 . The second one illustrates the Doob-Meyer decomposition: 
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W 2 is a submartingale, and is written as the sum of a martingale, : W 2 :, and an 
increasing function, t of bounded variation. 

Manipulation of stochastic integration can be summarised by the Ito multipli- 
cation table: keep all differentials in dt up to first order, using dt.dW = and 
dW.dW = dt. From this, we can get the important relation between a certain 
parabolic partial differential equations known as Kolmogorov's forward equation, 
and the corresponding stochastic differential equation. Suppose that Xt satisfies the 
stochastic differential equation eq. (fFip, with initial r.v. equal to Xq, which has law 
p{x). Let p(x,t) be the law of Xt; then it can be shown that p(x,t) is smooth and 
satisfies the parabolic equation 

+ (72) 

with initial condition p(x, 0) = p(x). To see why this is, we note that if f(x) is any 
smooth function, we can apply Ito's lemma to the random process f(Xt). We recover 
/ p(x , t) f (x) dx as E[f(X t )\X t = x\. We now expand f(X t +dt) in a Taylor series 
about Xt up to second order in dW: 

Bf 1 8 2 f 

f(X t+dt ) = f(X t ) + J-dX + -^{dXf. (73) 

Eq. @ tells us that (dX t ) 2 = b 2 dt and dX = adt + bdW. Here, dW is the for- 
ward difference. Then the expectation vanishes: E[f'bdW\Xt — x] = E[f'b\Xt = 
x]E[dW\X t = x] = 0, since dW is independent of f'b at time t, and has zero expec- 
tation. So, taking the conditional expectation of eq. (fT3|), 



E[f{X t+dt - f(X t )\X t = x]= E&-a] dt + l -E[b 2 f"\X t = x] dt. (74) 

ox 2 

Since a, b, /,/',/" are functions of Xt,t they become sure functions, evaluated at x 
under the conditioning; thus we get the equation for the increment f(x,t + dt) := 
E[f{X t+dt \X t = x]: 

t + dt)- f(x))/dt := Cf = (l/2)b(x, iff" + a(x, t)f. 

This is Kolmogorov's backward equation, which applies to the dynamics of the process. 
To get the dynamics of the probability density, we take the dual operator C* , defined 
by 

p(x,t)£,f(x,t) dx = / £*p(x,t)f(x,t)dx 



which on integration by parts, and discarding the boundary term at oo gives 

1 9 /,, ,o d „\ d 
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Since / was arbitrary, we see that p(x, t) satisfies the forward equation in the weak 
sense (after smoothing with a test-function /). It is known from the theory of elliptic 
regularity, that any weak solution is a strong solution. If a and b are constants, we 



arrive at the Smoluchowski equation, and the continuum version of (51): 

p(x,t)=E[p(X t ,0)\X(0) =x}. 

This representation for the solution of the pde gives an immediate proof that the 
solution remains non- negative if the initial condition is non-negative, since p(Xt, 0) > 
0; also, one sees that the time-evolution must be a contraction in the L°°-norm, and 
the L 2 -norm as the conditional expectation is a projection. 

Sometimes, we can rewrite the solution Xt in terms of time-translation u t— > uT% if 
we modify the measure f)S|l . Suppose y! is absolutely continuous relative to [i. Then 
there exists an adapted process u(t) in (Q, B, fj,) such that 

dX t = dW t + u(t)dt, X = 0, (75) 

has a weak solution Xt whose law is the same as Yt(u>) := Lv(t) as a r. v. on (Q, B, n'). 
Then the Radon-Nikodym derivative is 



d\x jd\i exp 



t rt 



u{s)dX s - (1/2) / ||u(s)|rds 

J 



(76) 



Conversely, if u is such that the r. h. s. of (|7q ) has Wiener expectation 1, (as will 
happen if u is bounded), then there exists an absolutely continuous measure \J given 
by (|76|), such that T t * on (f2, £>,//) produces a weak solution to (|75|). This is the 
Girsanov-Cameron-Martin theorem. 

This change of measure is closely linked to the change of ground state in the 
corresponding quantum theory, when an interaction is introduced. We see this in the 
Feynman-Kac formula, below. 

One can, using similar methods, integrate adapted functions relative to dM, 
where M is any martingale. The stochastic integral has other variants, such as the 
Stratonovitch version |3^, |4l| ; one can also integrate non-adapted processes, subject 
to other conditions (Skorokhod), or use another noise which is not quite a martingale 
[]59| |6Cf| . The Ito version has an interesting interpretation in mathematical finance. 
Suppose that the price of an asset is a random process St, and it obeys the Ito equation 

dSt = a(St,t)dt + b(S t ,t)dW t . 

If we choose to hold ip(t) units of this asset, our portfolio at time t is worth tp(t)St. 
The change in the value of our portfolio in time dt is d(ip(t)St), and we evaluate this 
as (p(t)dSt, because we do not change our holding ip{t) until after we have seen the 
change in the asset price. Here dSt = St+dt — St, so the total change in the asset over 
the time-interval [0, T] is the Ito integral Jq ip(s)dS s , in which 93 is adapted and the 
stochastic increment is the forward difference. 
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We now give a brief account of the Feynman-Kac formula pl| . Feynman re- 
lated the quantum transition amplitude (ip , e~ lHt <ft} to the integral over histories of 
where L is the Lagrangian [p2[ . The trouble is, the Feynman 'integral' 
over histories is not based on measures, but on oscillatory integrals, and these rarely 
converge. In quantum physics, the spectrum of the energy is bounded below (at least 
at zero temperature). This expresses the stability of the theory. It follows that the 
unitary time-evolution group e~ lHt has an analytic continuation to complex times 
with negative imaginary part. In particular this is true of all the matrix elements of 
this operator. This is the underlying fact used in Euclidean quantum field theory, but 
also holds for quantum systems without any large symmetry group; only invariance 
under time-evolution is needed. In particular, we can consider the group for negative 
imaginary times, giving a semigroup e~ Ht . The large-time behaviour of this is very 
good. This was used by Nelson |3<|] to study certain perturbations of the free Hamil- 
tonian: it is easier to study perturbations of a contraction semigroup than a unitary 
group. 

Theorem 4.3 Let Hq = —^-§^1 and V be a real-valued C°° -function of x S R, 
vanishing at 00. Then Hq + V is self-adjoint on DomHo and 

e-^+^V) = J ip(u(0))ip(u(t)) exp (- J* V{u{s)) ds^j dfx. (77) 



For the proof, see |6^] or |64j| . For a version within quantum probability, see |p5fl . 
In this way, we construct an interacting theory in terms of a path integral using the 
Wiener measure /i, weighted with an exponential function. The similarity with the 
Gibbs state of a system of paths in a potential V is noteworthy. Suppose that V = 
outside a region A, and converges to +00 inside A. Then we see from Feynman-Kac 
formula that the measure vanishes on all paths that enter the region A. After a 
normalisation, the weighted measure thus becomes the conditional Wiener measure, 
/i( . \uj(t) ^ A for all t). The formula then solves the heat equation subject to the con- 
dition of no-flow through the boundary <9A. We do not need to find this conditioned 
measure to use the formula; we can, for example, use the Monte Carlo method, and 
sample paths by computer, rejecting any that enter A; we can also use the conditioned 
measure to get results on monotonicity, since e. g. if the region A is enlarged, obvi- 
ously more paths are allowed, and so the integral of a positive integrand is increased. 



This relation with pde's has developed into the subject called potential theory [51], 
and is one of the tools used in constructive quantum field theory |6(L |67], B8L |69|] . 



Dyson saw the usefulness of using imaginary time in quantum field theory [70]. 



Schwinger [71] had introduced the idea of the Euclidean quantum field as a way 
of avoiding the difficulties of Lorentz invariance; these are replaced by invariance 
under 0(4), the orthogonal group; since we analytically continue all the time-ordered 
functions to imaginary time, time t gets replaced by it, often attributed to Minkowski. 
In fact, Minkowski did not know about the consequences of positive energy; he did not 
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analytically continue anything, but simply replaced time by —ix^, where X4 = it. This 
means that he considered the complex 0(4), and the invariance group was a particular 
subgroup L of it consisting of matrices some of whose entries were complex. In fact, 
L is isomorphic to the real Lorentz group, and is thus non-compact. Nothing has 
been gained by Minkowski's trick. Indeed, lots of confusion arose in electromagnetic 
texts up until recently, where other four-vectors such as were regarded as having 
a complex zero th component. Schwinger's programme of Euclidean field theory is a 



special case of a theory developed by Wightman |72], 73], in which the expectation 
values of the field are proved to have an analytic continuation in all the space-time 
components, into a domain that includes real position variables and purely imaginary 
time. 

Symanzik [74| started the mathematical programme of Euclidean quantum field 
theory. Glimm and Jaffe developed constructive quantum field theory using their 
theory of the perturbation of contraction semigroups. This is almost a Euclidean 
point of view. A beautiful probabilistic version of the subject resulted from Nelson's 
rewrite of Symanzik's programme. Let us outline this for the quantum mechanics of 
an oscillator. 

We start with the self-adjoint Hamiltonian 



1, d 2 _ 



11 // (l+ r-=^(-^ + g 2 -l) (78) 



Then the lowest eigenvalue, say 0, is simple; let U(t) = e~ tHt and let ipo be the 
eigenfunction of the eigenvalue 0. Then tpQ > holds. That is, there are no nodes 
in the ground state, a kind of Perron-Frobenius theorem. It is then convenient to 
replace the Hilbert space of the theory, H = L 2 (R, dq) by the unitarily equivalent 
space W = L 2 (R, \ip {q)\ 2 dq). The unitary map W : H W is given by (Wip)(q) = 
i/j(q)/ifto(q)- This is obviously organised so that Wipo = 1, the unit constant function 
in Tt'. An observable A, acting on Tt, is converted to A' = \VAW~ 1 . The operator q 
commutes with W, so is unchanged; but its canonical conjugate, p does not commute 
with W, and neither does q(t) := U(t)qU(—t), so these operators do not take the 
usual Schrodinger form on Tt'. 

The positivity of the energy ensures that the Wightman function (1, q(t\) . . . q(t n )l) 
has an analytic continuation to purely imaginary times, 

tj = isj, such that Sj — Sj + \ > 0, Sj G R, j = 1, . . . n — 1. (79) 

Define the Schwinger function 

S n (si, ...,%) = W n (isi, . . .,is n ) (80) 



at points given by eq. (|79|); we take S n to be defined by symmetry in the other 
regions; since the w n are symmetric at real points, the n\ analytic functions coincide 
at a common boundary of real dimension n. So by the edge-of-the-wedge theorem 
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[ [731 there is one common analytic function coinciding with these Schwinger functions. 
Obviously, S n determines W n , by the uniqueness of analytic continuation. 

Then two properties hold: there is a stochastic process X(t) such that S n is the 
n th momen t : 

S n (si, ...,s n ) = E[X(s 1 ) . . . X(s n )]; 
Moreover, the process is stationary and Markovian; that is 

E[X t \B< s ] =E[X t \B s ], fort>s. (81) 

Here, B< s is the c-tribe generated by X r , r < s, and B s that generated by X s . 
Neither of these properties is true for a general Hamiltonian theory, so they reflect 
somehow the Lagrangian origins of the theory. 

We can recover the physical Hilbert space as the initial space, L 2 (f2,£>o> m) § en " 
erated by powers X(0) acting on the vacuum, ipo which is the function 1. Also q is 
then multiplication by X(0). The Hamiltonian can be recovered by the identity (c./. 

(HD) 

e- m P(q)^ = E[P(X(t))\B ] (82) 

for any polynomial P. This is the continuous version of the fact that the transition 
matrix of a Markov chain can be recovered as the conditional probability of one 
time-step. We find 

(Vo, q(tx)q(t 2 )ip ) = (1/2) exp{*(ti - t 2 )}. (83) 

This leads by analytic continuation to 

S( Sl ,s 2 ) = (1/2) exp{-| Sl - s 2 |} = E[X(s 1 )X(s 2 )} (84) 

where X(t) is the Ornstein-Uhlenbeck process. 

Nelson was able to follow this programme for the free quantised field, and so 
rewrite the problem of finding solutions to relativistic quantum fields in terms of 
generalised random fields. A selection of good reading on this subject is [75, 76, 77, 
78l|7l. 



5 Quantum Processes 

Is friction a classical concept? 'There is no friction in quantum systems: the ground 
state of the atom does not grind to a halt. The introduction of friction, e. g. the 
term — jx in Newton's laws, is to account for atomic phenomena such as radiation 
of moving charges, in a very crude way. Such effects are treated exactly in quantum 
mechanics, and therefore frictional terms do not appear'. The view is still widespread 
but not universal among physicists. Friction does not appear in classical mechanics 
either if it is not put in. 
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A quantum process is, in a general way, a Hilbert space TL and a family of self- 



adjoint operators {A(t)} t >o on TL. A quantum field used as noise appeared in [80 1. 
Senitzky obtained the approximate dynamics of a quantum oscillator by reduction 
from the dynamics of a larger conservative system. He arrived at the following 
quantum Langevin equation with a Gaussian positive-energy quantum driving term 
((/?(£), vr(t)) (the noise): 

^ = uP{t) - 7 Q(t) + <p(t) ^ = -uQ(t) - 7 P(t) + 7r(t). (85) 

He noticed that without the 'noise', the Heisenberg commutation relations fade with 
time: [Q(t), P(t)] = ie -27 *; he considered this to be inconsistent with quantum me- 
chanics. With the noise, the solutions obey [Q(t),P(t)] ~ i for all time. The noise 
was a free quantum field with constant energy spectrum from to oo. This does not 
quite satisfy the requirement that the Heisenberg cummutation relations should hold 
for all time. In we found the general exact solution to this problem. A special 
case is 

<p(t) = 2- l l 2 {a{t) + a*(t)), 7r(t) = »2- 1 / 2 (a(i) - a*(t)), 



POO 

a(t) = (2 7 /^) 1/2 / e- ikt a{k) dk, [a(k),a*(k')] = 5{k - k') 



where 



This has a constant energy spectrum from u to oo. The feature of this solution, and 
Senitzky's approximate solution, is the relationship between the dissipation 7 and the 
correlation of the quantum noise, which at zero temperature is 



(a{s)a*(t)) = —e 



7r t — s + ie 

This is called the fluctuation-dissipation theorem. 



Lax [82] used noise with all frequencies, with two-point function 



(a(s)a*(t)) = ls(t-s). 

This is closer to the classical white noise, in that the increments to the process are 
independent, and the field obeys a quantum version of the Markov property. It was to 
be used later by Hudson and Parthasarathy in a rigorous body of theory |8^, . As 
physics, it was criticised by Kubo and others, as violating the KMS condition, which 
comes from the axiom of positive energy jSJ. The correct treatment (at non-zero 
temperature) was obtained by Ford et al., by taking the limit of one oscillator 
coupled to a large system of oscillators (or a string J8"6[ ). This was truly the quantum 
Langevin equation, in that the noise is added only to the equation for P and not 
to Q. This can also be obtained [87] as a singular limit of the asymmetric solution 



given in M]. The quantum noises in [Bq, pm are not martingales, and have not got 



independent increments. They do fit in to the axiomatic scheme offered in |88[. In 
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Ford emphasizes the role played by causality. Instead of eq. Q43|), he considers 
the equation with memory 

mx+f fi(t-s)x(s)ds + V'(x) = F(t). (86) 

J — oo 

The fact that the dissipation due to the future must be zero leads us to consider 
only those ji which vanish for negative argument. Perhaps this is a lesson for those 



p0| , 91, 92, q^, 83, who like to work on Lax's version. 

The first work to use the words 'continuous tensor products' (CPT) was The 
notable conclusion was that the theory can always be embedded in a boson Fock space; 
the Wiener chaos is an example of this. We start with a definition of current algebra, 
or better, current group. Let G be a Lie group, with Lie algebra G, and denote by 
T>(G) the set of C°°-maps from R n into G, being the identity outside a compact set. 
We can furnish D(G), the current group, with a group law by pointwise multiplication: 
fg(x) := f(x)g(x). This group has a Lie algebra, denoted T>{Q), which is the set of 



all C°°-maps F : R n — ► G, of compact support, under the pointwise bracket [92] 

[F(f),G(g)} := [F,G](fg). 

The problem is to find representations of the current groups and the current algebras, 
by unitary or self-adjoint operators respectively. 

Guichardet proposed a construction for the tensor product of Banach spaces 
or algebras, labelled by a continuous index. The first thing is to define, if possible, 
the continuous product of f(x) over x 6 R n , when / has compact support. He tries 

IJ f(x) := exp log /(*) dx) . (87) 

For Hilbert spaces, we wish to define the scalar product between two fields of vectors 
tp(x) and 4>{x). We put f(x) = (ip(x), (j)(x)) and use eq. (|S7|), provided that f(x) = 1 
outside a compact set and we take log 1 = (the principal branch). We then need 
to be able to extend the scalar product to linear combinations of product vectors. In 
[p4| , we give an example of a non-existent Hilbert continuous product, in that the 
positivity fails on linear combinations. Guichardet presents a class of Hilbert spaces 
for which the construction works, and writes the Fock representation of the free field 
in these terms. To explain his examples, let TC be a Hilbert space, and T(7i) the Fock 
space over TL. We define the map expW — * r(Ti.) by 



exp ( 



10 00 2~ 1/2 6 6 © ... © (n!)~ 1/2 © r 



The exp</> £ is called the coherent state determined by the one-particle state 4>. 

One shows that they form a total set (their span is dense) in T(TC); clearly, 

(exp<^, exp^) = exp(<^, if)). (89) 
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In p3[| , the Hilbert spaces H x at each point is itself the Fock space T(H) of a Hilbert 
space H , and the family X consists of coherent states at each point. This is a special 
case of the construction given below. 



The case of current groups was treated in [95, 9C[. We give here a special case 
when the continuous label is R, interpreted as time; we start with (H, U, if>), where H 
is a Hilbert space, if) G H, and U is a representation of G on H such {U(g)if),g £ G} 
has dense span. The triple (H, U, if)) is called a cyclic representation of G. 

We say that (Hi,Ui,if)i) and (Hi, U%, fo) are cyclic equivalent if there exists a 
unitary isomorphism W : Hi — ► H2 such that for all g £ G, 

WUi(g)W~ l = U 2 (g); Wif)i = if) 2 . 

A cyclic representation gives us a function on the group, analogous to the character- 
istic function of a random variable. Indeed, it reduces to the characteristic function 
when the group is R. Thus 

C(g):=(if),U(g)if)). (90) 

Let SpanG denote the complex vector space of finite formal sums of elements of G. 
Then C is continuous and of positive type on SpanG, which determines (H,U,if)) 
up to cyclic equivalence. Conversely, a continuous function C of positive type on G 
determines a cyclic representation (H,ir,if)) related to C by eq. (|90|) . The construction 
is very similar to the proof of the GNS representation. First, we construct the vector 
space, SpanG, and furnish it with the scalar product, determined by its values on the 
linearly independent elements gi,g%, ■ ■ ., by 

(gi,9j) = c^r 1 *); 

we complete SpanG in the norm (or, if a semi-norm with kernel K, we complete the 
quotient SpanG/iT), giving the space H. Then we choose if) to be the identity of 
the group. The operator U(g) can be defined on SpanG as left multiplication; this 
is easily shown to be unitary, and so can be extended to the whole space to get the 
representation U of G. 

In an infinite tensor product over a discrete index, von Neumann was able to end 
up with a separable Hilbert space only by labelling a special vector, say ip x in each 
factor H x , and then considering products ®<f) x of vectors in a subset A that at infinity 
are close to ip x - Only then does the infinite product 0( < A^>V'a; 

) converge. The tensor 

product then carries the labels {if)(x), A}. Guichardet used a similar idea for the 
continuous product. We are less ambitious, in that we ask for the tensor product of 
a cyclic representation (H,U,ip) of a group. We use the same representation at each 
point of the time axis, because we want to get a stationary quantum process. We 
then define the function C : T>(G) — > C as 

C(g(.):=l[{ip,U(g(x))i()), (91) 
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which is well defined if we choose at each x one branch of the logarithm. To get 
a representation of the current group, it is necessary and sufficient that this be of 
positive type on the current group, in which case we say that the CTP exists. We 
also want the function to be extendable to step functions, constant in an interval [s, t] 
and the identity outside. For such a g( . ), we divide an interval [s, t] into an arbitrary 
number, N, of equal intervals; then C(g) is the product of N equal factors, each a 
characteristic function on G. Thus C has the property that it has an iV th root that is 
also a characteristic function. Such C is called infinitely divisible. By the relation of 
characteristic functions to cyclic representations, we are able to transfer the concept 
of oo-divisibility to cyclic representations: 

Definition 5.1 Let (H.,U,ip) be a cyclic representation of a group G. We say ffth^ 
that it is oo-divisible if, for any integer N > 0, there is another cyclic representation 
(W 1 /™, f 1 /", V ;1//n ); called the n th -root, such that (7i,U,ip) is cyclically equivalent to 



(®H l/n ,®U l/n ,®i) l/n ) 



where the tensor product is over N factors, and the resulting representation is re- 
stricted to the cyclic subspace spanned by the group acting on the product vector 

We see immediately that if for some n the n th root of the representation exists, then it 
is unique (up to cyclic equivalence). For, the characteristic function of two n th -roots, 
C\,C2 say, both satisfy Cf = C, and so their ratio is uj n , an n th -root of unity. But 
this violates positivity unless oj n = 1. The converse also holds: if C is the product of 
n functions of positive type, then C itself is of positive type. In (9^j we assumed that 
C(g) never vanishes; we prove this later. 



Following [95] we can now give the criterion for the positivity of the scalar product 
in a continuous tensor product ?i x of cyclic group representations, relative to 
the cyclic vector ip and the set of states A := {U(g)ip : g £ G}. 

Theorem 5.2 The following are equivalent. 

1. The function C(g) is a continuous function of positive type on G with C(e) = 1, 
and is oo-divisible. 

2. There exists an oo-divisible cyclic representation (H, U, ofG such that C(g) = 

3. ®^ ,A exists. 

4- C(e) = 1 and a branch oflogC(g) is a conditionally positive function on G. 

In (3) and (4) the branch of the logarithm is determined by which root of C is of 
positive type. Only the item (4) needs explanation. A function F(g) on a group is 
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said to be conditionally positive if 

for all n-tuples (g±, . . . , g n ) of group elements and all complex n-tuples 
(#!,..., z n ) summing to zero: J2i z i = 0- 

To sketch the proof, if G is oo-divisible, and C = e F , then C s is also of positive 
type, for all small s > 0. Then 

^2 z iZj {l + sFij + ...)> 0, (92) 

and so if Y^i z i = 0> we S e t that F is conditionally positive semidefinite. For the 
converse, if F is conditionally positive definite, then e F is of positive type for all 

s > 0, see fH, P a g e 280 - 

The following result is called an Araki- Woods embedding theorem p5[ , because of 
the similarity with |k|, (but with different hypotheses). We remark that under the 
above conditions F is conditionally positive semidefinite; then the function 

(g,h) :=F(g- 1 h)-F(g)-F(h- 1 ) (93) 

is of positive type, and so can be used to define a semi-definite form on SpanG by 
sesquilinearity. 

Let K, be the (separated, completed) Hilbert space formed using this as scalar 
product on SpanG. Let Go be the subgroup of G such that U(g)ip = e if) for some 
real A. We see that (g,h) vanishes on Span Go, and defines a scalar product on 
SpanG/(SpanGo), (perhaps after identifying vectors of zero norm with zero). We 
then complete this to give a Hilbert space, /C. We see that the equivalence class of 
the identity e € G is the zero vector in fC. The original cyclic representation (Tt, U, tp) 
can then be embedded in the Fock space over JC, as follows: define the map W from 
H to r(/C) by its action on the total set U(G)tp: 

W(U(g)iP) = C(g)exv[g],geG. (94) 

One easily sees that this preserves the scalar product, using (p3|). Thus it can be 
extended by linearity and continuity to 7i. We see that the cyclic vector ip is mapped 
to the 'vacuum' vector ipQ of the Fock space. As for the group action, we use the fact 
that G/Go is a g-space, with left multiplication r g [h] = [gh]. This defines an action 
exp{r 9 } on the Fock space as usual, by its actions on the coherent vectors: 

exp{r 9 } exp[/i] := exp[gh]. 

Define an operator U' closely related to exp{r 9 }: 

U'{g)C{h) exp[h] := C(gh) exp[gh] (95) 
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Then by calculation one sees that (Ti., U, tp) is cyclically equivalent to the cyclic sub- 
space of (/C, U',ipo); W intertwines U and U' and maps ip to ipQ = exp[e]. From the 
unitarity of U' we see that \C{g)\ 2 = e'^M) ^ 0. 

The Gaussian measure is oo-divisible, and the representation of the translation 
group, U(X), with Gaussian cyclic vector ip{x) = (2n)~ l / A e~ x / 4 , is oo-divisible. The 
corresponding CTP contains Brownian motion §2; the continuous product ®qU(X) is 
the exponential martingale. A representation of the oscillator group is oo-divisible, 



and the CTP of this is the free non-relativistic quantised fields [92| 



H. Araki independently obtained similar results [96]. Instead of oo-divisible cyclic 
representations of groups, Araki started with a factorizable representation of current 
algebra. He remarked that, putting [g] = 4> g the map V(g)<fth '■= 4>gh — 9 is a unitary 
representation of G; this is proved on the vectors 4>hi 0fc by use of (|93[). The equation 
expresses that the map g i— > 9 £ K, is a one-cocycle of the group, with values in fC. 
We briefly explain this. 

So, let G be a group, and let fC be a Hilbert space on which G acts by unitary 
operators g i— > V(g). We shall write the left action (j) i— > V{g)4> as left multiplication, 
(j) i — > gcfi. The right action, which appears in the general theory of group cohomology, 
is taken to be trivial: <pg = 0. An n-cochain with values in K, is a map from G n into 
/C, that is, it is a function of n group elements with values in /C, thus: 4>(gi, ■ ■ ■ ,g n )- 
We shall need only the 0-cochains, which make up the space C° := K, of vectors 
independent of g, and the 1-cochains, which are vector fields (p(g) £ K, defined on the 
group. These make up the vector space C . We shall also need the 2-co-chains, when 
K, = C; these are complex- valued functions of two group elements. We see that the 
cochains of any degree k form a vector space C k . Fundamental to any cohomology 
theory is the coboundary operator, which is a linear map, 5 : C k — > C k+1 , so increasing 
the degree of the cochain. It obeys 5 2 = 0. In the case of a group G and a left and 
right action of G on /C, 6 is the linear map defined on C° by 

On C , 5 is the linear map defined by 

(5<t>i)(gi,g2) = 31 01 (52) - 01 (31 32) (31)52 • 
On C 2 , 5 is the linear map defined by 

{H2)(gi,g2,gz) = gi 4*2 (32, 33) - 02(3132, 33) + 02(31,3233) - 02(31,32)33- 

The vector space of cocycles of degree k in a vector space /C, with left and right 
actions ti,T2, is denoted Z k (G,)C,Ti,T2). One checks that 5 2 = 0. A coboundary of 
degree A: is a vector function of the form 5ip, where is a cochain of degree k — 1. 
The coboundaries of degree k form the vector space B k (G, V, t\, T2). Since 5 2 = 0, we 
see that every coboundary is a cocycle. If the converse holds, the cohomology group 
H k := Z k /B k , is trivial. One sees that if is a one-cocycle in C l (G,)C,V), then 
(0(3r X )' 0(32)) 1S a two-cocycle in C 2 (G,C,I). 
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A 2-cocycle a(g, h) with values in the unit circle is also called a multiplier for 
the group. A multiplier representation of a group G is a map g i— ► U(g), g £ G, 
such that U(g)U(h) = a(g, h)U(gh) for all g,h £ G. Although Wigner's analysis of 
symmetry in quantum mechanics leads naturally to multiplier representations, their 
occurrence is sometimes called an 'anomaly' by physicists. When the CTP exists, we 
can represent the element g( . ) of the current group by the operator (®C7) ff , defined 
on the product vectors (& x U{h{x))ift x by 

(®U) g (® x U(h[x))il> x ) := ® x U(g(x)h(x))il> x , (96) 

The space of the CTP is then r(/ ffi expfCdx) and A consists of coherent states of the 
form exp 4>g(x) ■ So we obtain a local representation of the current algebra. We get a 
multiplier when the branch of the logarithm in (91) obtained by the group law differs 



from the one needed to give a function of positive type on the group. This gives rise 
to an anomaly. 

Araki showed that if (ft is the cocycle defined by the oo-divisible representation 
U, then it is necessary that Im(<^(<7j~ ), ^(32)) be a coboundary. Conversely, given 
a cocycle (ft with this property, it comes from an oo-divisible representation. He 
proved that if G is compact, then any cocycle is a coboundary, i. e. of the form 
(ft g = (V(g) — I)x f° r some x € JC. Use of a coboundary leads to a CTP of the 



form assumed by Guichardet [93]. Araki was able to obtain analogues of the Levy 
formula dBlf ) for various groups; for the group R this takes on a new meaning, as 
the decomposition of a cocycle into its parts coming from primitive cocycles, some 
algebraic and some topological. The topological cocycles are of the form (V(g) — J)x; 
it is not a coboundary because \ is not in /C, but lies in a larger space that admits an 
extension of V; the V(g) — I brings the vector back into JC. Some groups, e. g. R, 
also have cocycles called algebraic by Araki. For example, in the case G = R, take 
K, = C, and V(a) = I for all a £ G. The cocycle is (ft(a) = a. Then ((ft a , fa) = ab is 
real, and C(A) = exp{— ^A 2 }, the characteristic function of the Gaussian distribution. 
The Poisson part of the Levy formula comes from the coboundaries, and the Levy 
processes from the topological cocycles. 

The question arises, given /C, V and a cocycle g ^ (ft g , can we construct a CTP? 
We can construct (TC, U(g),ift) from C, which can be regarded as a function such that 
C(e) = 1 and the map C(h) exp (fth 1— ► C (gh) exp (ft g h is unitary. The next big step 
was by Parthasarathy and Schmidt ]97|| , who showed that given a cocycle there is 
indeed an oo-divisible representation associated with it, but that it is a multiplier 
representation, with an oo-divisible multiplier a. The corresponding function C(g) is 
o"-positive. This means that 

Y,ZizA9l\9i)C{gT l 9i) > 0. (97) 

ij 

Naturally, this gives to a multiplier representation of the current group in general, 
and they found the multiplier; this leads to a tidier theory than (9(|], since the condi- 
tion for the absence of multiplier can be dropped. Since the physical interpretation 
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of a symmetry group leads (according to Wigner|98|]) to the ambiguity of the induced 
unitary representation up to a coboundary, the projective theory is certainly the right 
setting. Holevo has presented some similar concepts at the level of the algebra of ob- 



servables, and found applications in quantum theory [45|. Notable in the development 
was the work of Gelfand, et al. [|99| who used a co cycle of SX(2,R) to construct a 
factorisable representation of the corresponding current group. The whole theory is 



well explained in 100 , 101]. 



A theory of processes with independent increments and values in a Lie algebra 



Q was developed in | 102 |, extended to multiplier representations by Mathon [ 103 ] 



and to Clifford algebras in [104]. Corresponding central limit theorems were proved 



by Hudson, and Cushen and Hudson [105, 106]- A Lie process can be obtained 



by differentiation of the corresponding object for a Lie group. For example, near 
the identity any group element g lies on a one-parameter subgroup generated by an 
X £ Q, and we write (Exp means the exponential map from Q to G, not the Fock 
map) g[t) = ExpiX, g(0) = e, g(l) = g; given a representation U(g) we get a 
representation of Q by ir(X) = d/dt[U(g(t)]t=o. By Stone's theorem, X is self-sdjoint. 
However, given a cyclic vector tp for U it does not follow that ifj is cyclic for tt, 
because of domain questions. Let £ be the universal enveloping algebra of Q. This is 
the nonabelian polynomial algebra, modulo the ideal generated by the commutators 
XY — YX — [X, Y]. Here, [X, Y] £ Q is the Lie product, a polynomial of degree 1. A 
cyclic representation (7i, n, ip) is determined (up to equivalence) by a positive linear 
functional, or state, on £: 

x l x 2 ...x n ^^,it(x l )Ti(x 2 )...K(xM = w n (x l ...x n ). 

These are the noncommutative moments, or Wightman functions; they determine a 



representation, by the Wightman reconstruction theorem 73]. They are generated 
by the characteristic function 

C(A) = (ip, [/(ExpAiXi) . . . U(Exp\ n X n )ip), A £ R n . (98) 

Here, {Xj} is a basis of the Lie algebra, and any moment out of order is determined by 
a derivative of C and use of the commutation relations. The truncated functions Wt 
are generated by log C, 107 ] and are related to W by a formula similar to eq. (|l0|), re- 



lating cumulants to the moments. Two cyclic representations with the same W, or the 
same Wt, are cyclic equivalent. The cumulants of expU (the Fock construction) are 
the same as the moments of U; this follows from exp U(g) exp U(h)ip) = exp(U (gh)ip) 
and d|). 

Given two representations U±, U 2 of G, their tensor product U± (8) U2, restricted 
to the diagonal subgroup of G x G, gives the representation tti ® / + I ® vr2 of Q. 



This led to the use of a coproduct, though it was not recognised as such until [108]. 
Whereas a product on an algebra A is a linear map A ® A — » .A, a coproduct is a 
map A — > A (8> A. For Lie algebras the coproduct is X ^ X ® I + I ® X. Then we 
say that a cyclic representation (Tt, n, i/j) is oo-divisible if for each there is another, 
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{H 1/N , tt 1 /"" 1 , ip 1/N ) such that (H, tt, ip) is cyclically equivalent to Tt l / N ®I+I®it l - l / N . 
Starting at N = 2 this gives the concept of rational powers of tt. 

The differentiation of a CTP representation ®tUt(g(t)) of the current group leads 



to an ultralocal field [ 10S , |110f| . These are such that the truncated Wightman functions 
have the form 

W T (X X (f X ) . . . *„(/„)) = K n (X 1 . . . X n ) J hit) . . . f n {t) dt. (99) 

Here, {«:„} are the cumulants of tt = dU. The commutative analogue was analysed 
in |5q|. For Lie algebras, we found [|102|: 



Theorem 5.3 The following are equivalent; 

1) Eq. defines a representation ofV(Q). 

2) The K n are the cumulants of some oo-divisible cyclic representation of Q . 

3) The n n are positive semi-definite on £\, the subalgebra of £ with identity omitted. 

We note that (3) is the expression of conditional positivity at the algebraic level. 
Since the cumulants of exp U are the moments of U, we can get a set of n n that obey 
the positivity (3) by using the moments of exp U. These happen to have a positive 
extension to £: any conditionally positive functional is positive. Th. (5.3) has a 
cohomological version, which we outline. 

Let £ be an associative algebra with identity, IC a linear space and r a represen- 
tation of £ on IC. The p-cochain group C p (£, JC, r) is the linear space of p-multilinear 
maps (/):£ x ...£—>■ IC. The coboundary operator S : C p — > C p+l is given by 

{84>){x u . . . , x p+1 ) = T {x x )<t>{x 2 , Xp+^+^i-iy^Xx, XjX j+1 , x p+l ). 

Then 5 2 = and we define as usual the cocycle group Z* := ker 5 and the coboundary 
group B* := Ran 5, and the cohomology as H* := Z*/B*. {* means for any p). We 
see that a 1-cocycle is a map </> : £ — > IC that satisfies (p(XY) = r(X)(f)(Y), and a 
1-coboundary is a cocycle of the form 4>(X) = t(X)(J)o for some <^o £ K,. 

The states on £\ are positive elements of B 2 (£i, C, 0). Thus if (H,7r, if)) is cxd- 
divisible, then its cumulants Wt define a state on £i, and thus a scalar product: 
(X,Y) := Wt(X*Y). Here we define X* = —X, since we want tt to represent 
the generators iX of one-parameter subgroups by hermitian operators. Define IC as 
the separated prehilbert space obtained from £\ as usual. Let 4> : £\ — > IC be the 
embedding obtained from this, and define a *-action r of Q on monomials by 

rpO0(Xi...X n ) :=<t>{XX l ...X n ). 

This states that <f> is a 1-cocycle. We then show that there is a bijection between the 
set of oo-divisible cyclic representations (Tt, tt, ip) of Q and the triples (r, 4>, x), where 
r is a hermitian representation of Q on a prehilbert space IC, \ is a real character, 
and (j) £ Z 1 (£\,1C,t) such that 

7 := Im(0(X), 0(F)) G 5 2 (£i, R, 0). (100) 
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In this bijection, H is embedded in r(/C), ip is mapped to the Fock vacuum, and ir is 
related to expr [ 102 1 . So this is the Araki- Woods embedding theorem in this case. 



If (100) fails then we get a projective representation of Q, with multiplier a related 
to the cocycle 7 [103, 101]. We see that a cocycle for R is defined by a function 
X G ^(R) such that x\ £ L 2 (R). We thus see the origin of the condition near a = 

In [104] we show that for Clifford algebras, the only possible oo-divisible states 
are Gaussian (all cumulants above the second vanish). Here the coproduct is that of 
Chevalley, A 1— > A (g> / + (—1) F I (g) A where F is the degree of A, for elements of even 
or odd degree. 

The algebraic theory was extended to associative algebras (that were not envelop- 
ing algebras of Lie algebras) by Hegerfeldt, who applied it to classify oo-divisible 
quantum fields [107]. 

Goldin et al. have, independently of this work, constructed representations of a 
vector form of charge-current algebra, starting with the Fock space creation-annihilation 
operators [111]; they have been able to identify the representations in terms of the 
general anlysis of semi-direct products. 

Schurmann | 108 | introduced the concept of infinite divisibility for a representation 



of a Hopf algebra, and obtained essentially all the results of [102, 102, 104] in this 
more general setting. Stochastic integrals for these processes were also constructed. 
For a clear account, see [ 112 1 . 

Voiculecsu developed the algebraic side into a subject called 'free probability' 
[113], as it lives in full Fock space, without symmetry or antsymmetry. 

Albeverio and Hoegh-Krohn [114] have constructed representations of current 
groups, and been able to replace the independence at every point by a covariance 
similar to the Nelson free field. 



6 Quantum Stochastic Semigroups 

These models of non-commutative noise, or quantum noise, are possible driving ran- 
dom terms for noisy quantum dynamics. What should we be looking for in a nonequi- 
librium stochastic quantum dynamics? From 1970, E. B. Davies made progress in 
formulating stochastic quantum dynamics |115[| . Suppose that the C*-algebra of ob- 
servables is A. We look at the Fokker-Planck equation in the classical case, and we see 
that we might expect a quantum stochastic process to be determined by a semigroup 
(in continuous or discrete time) of maps Tj from the state space X(*4) to itself. It 
must map positive operators, the density matrices, to positive operators, and preserve 
the trace. We also do not want it to map a normal state to one of the finitely additive 
ones, so we require a stochastic map to obey 

1. T maps S to itself; 

2. T is linear; 
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3. In continuous time, \\(T t — — > as t — > 0. 

We can throw the action onto to algebra, to get the dual action T* : A — » A, by the 
requirement that for A£i, 

(Tp, A) = <p,TM) for all p G S. 

T* is automatically normal. We see that if .A is abelian, then our conditions reduce 
to the properties needed for a classical stochastic process. It is obvious that a uni- 
tary time-evolution gives us a one-parameter family of stochastic maps, which can be 
extended to a group by including the inverses. We can get a large class of stochas- 
tic maps by forming mixtures of unitary groups; thus if Tj is a family of invertible 
dynamics, then T = J2j ^j T j is stochastic if Xj > and J2\j = 1. Any stochastic 
map is non-invertible if it is not unitary, and so is in this sense dissipative |115[|, p 25. 



In addition, in the quantum case, Kraus [116] has argued that to get a satisfactory 



interpretation of the semigroup, T must be completely positive. We say that a map 
T : A i— ► A is n-positive if T <g) I n is positive on the algebra A (8> M", This is needed, 
since if our quantum system is described by the algebra A, and there is an n-state 
quantum system far away, then the combined system will be described by A <S> M n , 
and the dynamics on the combined system could be T (g> I n . This must be positivity 
preserving, or else some state of the combined system will evolve to give negative 
probabilities. Since we want to avoid this for all n, we want T to be n-positive for 

all n = 1, 2 Such a condition is called complete positivity. It should be said that 

any positive map on an abelian algebra is always completely positive, so this concept 
only seriously arises in quantum probability. 

Kraus showed that a map T is completely positive if and only if T{A) is a sum of 



maps of the form S*AS n , where the S n are bounded; [115], p. 140 



The great result in the subject is the classification of continuous semi-groups 



of completely positive maps. In finite dimensions this was achieved in [117], and 



independently, by Lindblad, [118] whose result holds for norm-continuous dynamics 



on C* algebras. Their result is the quantum analogue of the heat equation, i. e. it is 



a dynamical equation for the density matrix. For a simple derivation, see [119]. The 
result is: 

Theorem 6.1 Let Tt be a semigroup of completely positive stochastic maps on M™. 
Then there exists a Hermitian matrix H and matrices Sj such that the generator of 
the semigroup has the form 

Z{A) =i[H,A]-^{RA + AR) + Y / S*AS j , where R = J2 S j S r ( 101 ) 

j j 

This can be thrown onto the density matrices by duality. The first term i[H, A] is non- 
dissipative, and is called the hamiltonian term. The second term is the dissipation. 
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It is very interesting that the first two terms of the Heisenberg expansion of the 
dynamics are of this form. Thus, 

(e im Ae- iHt - A) t~ l = i[H, A] - [H, A]]t + 0(t 2 ) 

= i[H, A] - \{AS 2 + S 2 A) + SAS 
where S = Ht 1 / 2 , 



up to O(t), so it is of the form eq. ( |101[) with R = S . In the anti-van Hove limit Q 
we replace S by XH. 

It has been remarked that the commutator A i— ► i[H, A] is a derivation of the 
operator algebra, and so has many of the properties of a derivative. The double 
commutator has many of the properties of the second derivative, including some 
positivity, which mimics the positive spectrum of —A and the positivity improving 
properties of e At . Lindblad has analysed continuous semigroups of cp maps, with 
generator £, in terms of the 'dissipation operator', being minus the coboundary of L: 

D(A, B) := -5C(A, B) = C(AB) - C(A)B - AC{B). (102) 

He proves that T t := exp(i£i) is a continuous semigroup of cp maps if and only if D 
is positive in the sense that 

C*D(Al,Aj)Cj > for all A,, Cj G A. (103) 

ij 



Note the formal similarity with |96|, |95], 102, |97[| . Fannes and Quaegebeur [ 120 1 have 



defined the concept of oo-divisible completely positive mappings on groups, in which 
the function C(g) is replaced by a cp operator. They prove an Araki- Woods embed- 
ding theorem for such structures. 

Recall that for Markov chains, Brownian motion and Euclidean field theory, we 
can express the given semigroup as an isometric time-translation, followed by the 
conditional expectation onto the initial space. By using two-sided time, the isometries 
can be replaced by a unitary group. The finding of the appropriate unitary group is 
called the dilation of the semi-group. It is not unique, but there is a unique minimal 
one. [ 121 1 . It would be nice to interpret the dilated system as representing the full 
physics of system plus environment, with a unitary evolution; the projection onto 
a subspace represents our loss of information due to incomplete knowledge. The 
ambiguity of the dilation then shows that several different models give the same 
(crude) coarse-grained dynamics. However, it will rarely be the case that a dilation 
has the good properties, such as positivity of the energy, needed for this interpretation. 

This is illustrated in the quantum case, which in finite dimensions takes the form 

[ill 
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Theorem 6.2 Let Tt be a semigroup of cp stochastic maps on M n acting on TL. Then 
there exists a Hilbert space K,, a pure state p onTL®K, and a one parameter unitary 
group Vt onTL® K, such that 

T t (A)=E p [V t *(A®I)V t ] 

for all Ae M. and all tgR. 



This is proved by putting together Theorem (4.2) and §7.2 of [115]. Note that 
the Hilbert space /C is constructed by adding Wiener noise, and so is not finite- 
dimensional. The semi-group has been dilated to a unitary group on the Wiener 
space with two-sided time; the generator of time-evolution is not bounded below, 
since it has white spectrum. This does not represent an environment at any finite 
temperature. A special case is the dilation of the semigroup given by the anti-van 
Hove limit. In that case the process is given by 

X{t) = (2vrtA 2 r 1/2 / e- s2/{2x2t) U(s + t)XU{-s - t) ds. (104) 



This has the interpretation as the Heisenberg evolution, but with the time t slightly 
uncertain, and getting more uncertain in the future. This interpretation is only a 
slight variation on the methods used in the justification of the microcanonical state 
by ergodic theory. There, it is said that the atomic times are so small that we 
never measure an observable at a particular time; rather, we measure the average 
over the time < s < t of the measurement thus: A = i" 1 /q A(s)ds. Since t is so 
large compared with the atomic processes, we take the limit t — > oo. This idea is 
a non-starter for non-equilibrium statistical mechanics, since if the limit exists it is 
time-independent. Instead, we may say that we cannot measure an observable at an 
exact time, but form the weighted average, with Gaussian weight, around the desired 
time t. The uncertainty in the Gaussian is X 2 t, growing with time. A is the dissipation 
parameter. In models it turns out to be the hopping parameter of the atomic system. 

Some authors limit the concept of quantum stochastic process to the case where 
the possible observed path of measurements themselves make up a classical process. 
The grounds for this is that the observations (in a set of repeated experiments) have 
actually been seen; these form the quantum record; take them to form a sample 
space. However, this is not true. The process X(t) at different times might not 
commute, so the measurement of X(t) alters the state (by collapse), and subsequent 
measurements are not those predicted by X(t + s), s > 0, as computed using the given 
initial state. It needs conditioning to the new information, and quantum conditional 
expectations only commute on abelian subalgebras. Moreover, one can measure X(t) 
in one sampling and Y(t) in another, where X and Y do not commute. No classical 
model would predict the statistics of the process; the classical theorist is liable to be 
hit by the EPR paradox in acute form. We regard X(t) as the observable seen at time 
t when no measurement has been made in {s : < s < t}. So we cannot agree with 
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the idea that the randomness itself is caused by the reduction of the wave-function 
due to continuous measurement; it might be due to interaction with a large other 
body, but not one designed to measure any particular observable. 

Davies's dilation of the Lindblad semigroup uses a number of independent Wiener 
processes to provide the set-up. The question arises whether there is a relation be- 
tween quantum dynamical semigroups and a class of quantum stochastic differential 
equations, similar to the relation between the Fokker-Planck equation ([F2]) and the 
sde ([n]). For this, we need a quantum version of Ito's integral. In 1956, Umegaki 
defined the concept of conditional expectation in non-commutative integration theory 
[122]. Let A be a von Neumann algebra with a semi-finite trace, and say an oper- 



ator A is integrable if Tr|A| < oo. The vector space of integrable operators can be 
completed to form the space L 1 (^4). Segal and Nelson showed that there is a closed 
operator representing an element of the completion. Let At be an increasing family 



of subalgebras which generate A and are right continuous [123], such that the trace, 
restricted to each At is semi-finite. Then a conditional expectation relative to the 
trace is a linear map M : L^(A) — > L 1 («4t), t > 0, such that 

Tt(XA) = Tr(M t (X)A) for all A e At, X G L 1 (^4). 

A martingale is a process Xt of integrable operators such that 

M s X t = X s 

for all < s < t. This concept can be generalised to a filtration of algebra with 
specified state, rather than trace. 



Cuculescu [124] proved a martingale convergence theorem for discrete time. Bar- 



nett [123] obtained a martingale theorem for continuous time. This work persuaded 



us to look for examples of noncommuting martingales. Soon we found plenty within 



the theory of continuous tensor products |12q 1. Let (H, U,ip) be an oo-divisible rep 



resentation of a Lie group G, and consider ^^^TLt relative to the vector ®ip t and the 
set A of coherent vectors. Here, all factors are the same. To g £ G we associate the 
family of unitary operators 

Vt(g) := ®\U{g) ®T I- (105) 

We call such an operator simple, localised in [0, t]. Let At be the algebra generated by 
{V s (g)} with < s < t and g £ G. Then for s < t define the map M s : At — > A s by 
continuous linear extension of M s <g>* =0 V r (g) = <£>r = oV r (g). Then M s is a conditional 
expectation, and relative to M s , the family Vt is a martingale. Applied to G = R 
with t/j a Gaussian state, Vj is the exponential martingale of Brownian motion. When 
G is the oscillator group, the lie algebra is spanned by P, Q, H and a central element 
/. There is a representation by self-adjoint operators on L 2 (R), with the ground state 
of the harmonic oscillator as cyclic vector. This is infinitely divisible, and the unitary 
operators in (|105|) are copies of the exponential martingale e lWt for the subgroups 
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generated by P and Q, and is the Poisson exponential martingale for the subgroup 



generated by H |126| 1 . This became known as the gauge process 84]. All these 
martingales are defined on the total set of coherent states. Since they are unitary, 
they can be extended to an everywhere-defined unitary group, the generators of which 
are self-adjoint operators. This is the main technique of the Hudson-Parthasarathy 



calculus |2g, |8J, |4| 



Examples of martingales with trace were given in | 128 |. Consider the Fock Fermi 
operators b(f),b* (g) with anticommutation relations [b(f),b*(g)] = {f,g) for f,g £ 
L 2 (R + ). The algebra generated by these and the Fock condition 6(/)|0) = is 
represented on antisymmetric Fock space over L 2 (R + ) as the W* -algebra generated 
by the Fermi field ip(f) = b(f) + b*(f) acting on the Fock vacuum |0). The Clifford 
process is the set of operators 

*(*):= ^(£[0,*])- (106) 



The non-commutative integration theory [ [L29| , |130| , |131| ] , taking the place of measure 
theory, is that based on the hyperfinite von Neumann factor of type II±, which is 
furnished with a faithful trace <p(A) = (0\A\0). The completion of A in the norm 
\\A\\ = ip(A*A) 1 / 2 is denoted L 2 (A, cp). The projection M t from L 2 (A, ip) onto 
L 2 (At,y>) is the same as the projection from r(L 2 [0,oo]) onto T(L 2 [0,t]); it obeys 
the laws for a conditional expectation, and *$>(t) is a martingale. 

The increments of *&(t) are independent, but anti-commute. Otherwise, all the 
properties are analogous to Brownian motion. The isometric time-evolution analogous 
to the left shift of the classical theory is that given by the map U s : ^f(t) >— * ^f(s + t). 
The antisymmetric Fock space over L 2 (R) carries a unitary extension of U s , namely 
the second quantisation of translation in R. We define an adapted process hit) to be 
a family of operators such that hit) E At] it is simple if it can be expressed as 

n 

h=Y / h k -iX[t k _ 1 ,t k )on[0,t). (107) 

k=l 

We then define the stochastic integral of any simple adapted process, relative to ^f, 
to be that constructed in the manner of Ito, with the forward difference in d^>: 

/ /(a)dtt(a) := V h k -i (tf(t fc ) - *(t*-i)) . (108) 
Jo kTi 

As in Ito's theory, what make it work is an isometry property: 

Theorem 6.3 If hit) is a simple process made up of L 2 operators, then h(s)d^{s) E 
L 2 , and 

t h(s)d^(s)\\ 2 = f \\h(s)\\ 2 ds. 
Jo 
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The proof |128| ] is similar to Ito's. We use this to construct the integral of square- 
integrable adapted processes, and some LP processes, by extension to the completion 
of the space of simple adapted processes. The stochastic integral is the quantised field 

smeared with an operator h rather than a test-function. There is a Doob-Meyer 
theorem: M 2 is the sum of a martingale, denoted by [M t ,M t ] in classical theory, 
(NOT the commutator!) and an increasing process of bounded variation, denoted 
(M t ,M t ). Any stochastic integral is a martingale, and we show the converse, that 
any 1? martingale of mean zero is a stochastic integral. We also define the stochastic 
integral N(t) = J h(s)dM(s), where h is adapted and square-integrable relative to 
(Mt,Mt). Here, M is an L 2 -martingale. This representation of N is unique; we then 
write h as the stochastic derivative: h = dN/dM. We show that we can change 
variables in the integral: the stochastic Radon-Nikodym theorem [ |123| ] . 

We are able to show |132|1 that the quantum sde 

dX t = F(X t ,t)dM t + dM t G(X t ,t) + H(X t ,t)dt (109) 

has a solution in L 2 (A, ip) for F,G,H continuous, adapted and locally uniformly 
Lipschitz, for any martingale M.% of degree n, and that the solution obeys the Markov 



property fl33 |. 



Manipulations of differentials are similar to the Ito calculus: (dt) 2 = = (dt)(d^); 
(d^) 2 = dt. Pisier and Xu have obtained 'Burkholder-Gundy' inequalities within this 



theory |13g ] 



The central state 93 of the Clifford algebra corresponds physically to an infinite 
temperature. For the CCR and CAR algebras, we constructed the stochastic integrals 
starting with quasifree states with no Fock part, using the non-central state in place 



of the trace [135, 136 1 . This theory is somewhat technical ('unreadable' [|137| ). 

The general Lindblad semigroup can be dilated [ |138| | using the flow defined by a 
solution to a quantum stochastic equation in the sense of Hudson and Parthasarathy 



3], ^3, 139]. It was extended to some unbounded cases by Belavkin 140 ]. We now 



give a brief account of this, following Frigerio [141]. 

Let Tt = exp(Ct) be a semigroup of completely positive normal stochastic maps 
on the algebra BiTL). 

Theorem 6.4 There exists a Hilbert space T , a group {at ■ t £ R} of * -automorphisms 
of BiTL® J 7 ) and a conditional expectation Eq of B(TL® J 7 ) onto B(Tt)®I?r such that 

T t {X) ® Ij? = Eo[a t (X ® IpO], X e B(H), t e R. (110) 

The evolution at is a perturbation of the 'free evolution' a® on B(Tt), of the form 

at(.) = U(t)a° t (.)U(ty, (111) 

where {U{t) : t £ R} satisfies the cocycle condition 

U(t)a%(U(s)) = U(s + t), t,ser, (112) 
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is unitary and is the solution of a qsde in the sense of 84 ] . We give the details in 
the simplest case, eq. ( |101[) with only one term S in the sum. We take T = T(L 2 R), 
with total the set of coherent vectors exp</> : </> € L 2 (R) n L 1 (R). We define the 
annihilation process, creation process and gauge process on this total set by 

A(t)exp(f) = ([ <p(s)ds)exp(f) (113) 
Jo 

A*(t)expcj) = A eX p (0 + ex [0 ,t]) |e=o (114) 

A(t)exp0 = ^exp(e ex [°.*]^) | £=0 . (115) 

The conditional expectation Mt is as for the CTP, ®* =0 (.F S ), based on the Fock 
vacuum, and A(t),A*(t) are the creators and annihilators defined by the generators 
P, Q of the Heisenberg subgroup of the oscillator group; A is the number operator. 

We identify any operator X in B(7i) with its ampliation X®Ij?, and any operator 
Y with domain T> C T with the algebraic tensor product I^®Y. A family U (t) is 
found by solving the qsde 

dU(t) = U(t) [iS*dA(t) + iS dA* (t) + (%H - S*S/2)dt] , (116) 

with the initial condition U(0) = I. The structure of the equation is designed to 
ensure that the solution, defined on the set of coherent states, is continuous, unitary, 
and adapted. The term S*S/2 arises as the Ito correction, or as due to the Wick 



ordering [142]. To ensure that at obeys the group law, the usual free evolution a on 
the second quantisation of the translation group on L 2 (R), is chosen. It is then 
proved that a°_ s [U*(s)U(s + t)] satisfies the same qsde as U(i), and so, by uniqueness, 
must be U(t). So U satisfies the cocycle condition. On multiplying out, we see that 
a y is a group. 

The theorem for a semigroup with a finite number of operators Sj follows a similar 
line. □ 



There is a fermionic version of this dilation [ 143 ] 



Quantum stochastic calculus has become a mature field of mathematics. The 



approach of [p3 l, rather than [128], has the disadvantage that the stochastic integrals 
are defined as operators only on a dense set. It is not always clear that they have a 
unique closed extension. This is overcome in [|33"| , jS4[ by limiting the class of equations 
to those with unitary solutions. Another help in the analysis is by the use of Maassen 



kernels [144]. Alternatively, [145] one may give a meaning to these objects as maps 
between test-functions and distributions, using white-noise analysis. 

One problem with this work, and this includes [123] as well, is that the spectrum 



of the noise is white, so that random negative energy is added as well as positive 
energy. We saw that positive energy seems to exclude martingales ]^0|, ^T|. In fact, 
the KMS condition excludes the existence of a conditional expectation except in 
trivial cases. It has been remarked that it also excludes the Markov property and 
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the regression theorem [ |146|] , Lindblad has remarked |]147|] that for the oscillator, the 
KMS condition is not compatible with the axioms of dynamical semigroups. So to 
model random external forces in a real system, coupled to a heat-bath, the white noise 
sde is an approximation, that might be good if the time-interval is large compared 
with the memory time. These ideas are used to describe quantum systems like lasers, 
which are subject to external forces; this was the original intention of Senitzky and 
Lax. The modern version is described in E4q| . Since external forces introduce energy 
and entropy into a system, such models have two drawbacks: 

1. The first law of thermodynamics is not obeyed. 

2. The second law of thermodynamics is not obeyed. 

This is the starting point of |149| , |150| , p. One step of the linear dynamics is given 
by a bistochastic map p \— > pT, so that entropy increases. We require that T* maps 
any spectral projection of the energy to itself; this will preserve energy. To reduce 
the description, we then project the new state pT onto the information manifold A4 
defined by the set of slow variables, to get the state pTQ. To preserve mean energy, 
the energy must be a slow variable. The map Q is nonlinear and is interpreted as the 
thermalisation of the fast variables. Thus, after the map T, the system itself decides 
to find the best estimate pTQ to pT within A4. The resulting map gives a nonlinear 
motion through the manifold, obeying the first and second laws of thermodynamics. 
This theory, called statistical dynamics, is still being explored |25|, |152| , ||] . 
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